-- Logs begin at Fri 2022-06-24 07:53:39 UTC, end at Fri 2022-06-24 09:35:07 UTC. -- Jun 24 08:35:11.872766 dv-cinder-787296-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:35:11.882411 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:35:11 2022] *** Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: nodename: dv-cinder-787296-12-iscsi Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: machine: x86_64 Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: clock source: unix Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: pcre jit disabled Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: detected number of CPU cores: 4 Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: current working directory: / Jun 24 08:35:11.884948 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: your processes number limit is 47680 Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: your memory page size is 4096 bytes Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: detected max file descriptor number: 2048 Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: lock engine: pthread robust mutexes Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: thunder lock: enabled Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:35:11.885776 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:35:11.929582 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: Python main interpreter initialized at 0x55c1e02169c0 Jun 24 08:35:11.929582 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: python threads support enabled Jun 24 08:35:11.929582 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: your server socket listen backlog is limited to 100 connections Jun 24 08:35:11.929582 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:35:11.930036 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:35:11.930036 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: *** Operational MODE: preforking *** Jun 24 08:35:11.930321 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:35:11.930321 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: spawned uWSGI master process (pid: 109908) Jun 24 08:35:11.930555 dv-cinder-787296-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:35:11.931600 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: spawned uWSGI worker 1 (pid: 109909, cores: 1) Jun 24 08:35:11.931600 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: spawned uWSGI worker 2 (pid: 109910, cores: 1) Jun 24 08:35:11.931600 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:35:12.600550 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:35:12.606812 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:35:13.757133 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:35:13.757133 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: from cryptography.utils import int_from_bytes Jun 24 08:35:13.757819 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:35:13.757819 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: from cryptography.utils import int_from_bytes Jun 24 08:35:13.758637 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:35:13.758637 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: from cryptography.utils import int_from_bytes Jun 24 08:35:13.759071 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:35:13.759071 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: from cryptography.utils import int_from_bytes Jun 24 08:35:16.275419 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:35:16.276022 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:35:16.276238 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:35:16.276668 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:35:16.276761 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:35:16.276957 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:35:16.277046 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:35:16.277226 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:35:16.277386 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:35:16.277599 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.277749 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:35:16.278537 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.278657 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.278750 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.278824 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.278896 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.278968 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279044 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279118 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279190 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279394 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279501 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279674 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.279793 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280453 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280566 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280654 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280738 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280823 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.280918 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281008 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281093 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-12-iscsi {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281177 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281261 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281497 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-12-iscsi {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281595 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281846 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.281944 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282159 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282250 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282466 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282556 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282780 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.282872 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.283080 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.283171 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.283399 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.283575 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.283706 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284024 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284220 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284344 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284535 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284640 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284843 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.284937 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.285155 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.285258 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.285491 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.285590 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.285834 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286003 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286149 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286331 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286503 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286639 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286794 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.286910 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287169 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287273 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-12-iscsi {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287558 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287689 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287867 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.287992 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-12-iscsi {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.288185 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.288286 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.288574 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.288691 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.288890 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289001 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289222 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289322 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289540 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289639 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289894 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.289994 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290200 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290299 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290520 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290617 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290833 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.290937 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291153 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291260 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291467 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291559 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291765 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.291870 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292066 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292158 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292370 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292468 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292684 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292791 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.292985 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293087 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293285 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293383 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293538 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293641 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293859 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.293961 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294162 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294269 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294476 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294572 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294793 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.294887 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295034 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295137 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295296 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295452 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295601 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295690 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.295903 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296011 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296182 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296280 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296486 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296575 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296789 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.296887 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297092 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297181 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297393 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297483 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297716 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.297808 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298019 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298109 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298320 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298414 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298624 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298716 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.298933 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299021 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299249 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299342 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299553 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299641 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299868 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.299964 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300174 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300259 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300493 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300586 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300796 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.300890 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301125 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301242 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301436 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301530 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301761 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.301860 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302077 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302172 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302432 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302528 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302698 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302794 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.302999 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303095 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303303 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303398 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303605 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303700 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.303914 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304020 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304215 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304301 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304463 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304551 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304783 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.304871 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305084 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305177 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305402 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305505 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305724 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.305852 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306027 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306122 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306328 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306428 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306624 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306741 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.306949 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307045 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307222 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307338 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307521 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307620 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307822 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.307913 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308121 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308221 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308425 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308523 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308755 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.308866 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309014 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309112 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309316 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309414 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309620 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309828 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.309952 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.310090 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.310252 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.310343 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.310561 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.310687 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311124 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311224 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311425 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311512 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311731 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.311834 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312029 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312113 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312331 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312423 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312635 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312720 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.312935 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313028 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313237 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313329 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313547 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313630 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313876 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.313971 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314181 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314273 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314494 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314583 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314790 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.314884 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315093 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315178 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315397 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315491 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315698 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.315791 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316041 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316148 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316302 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316388 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316603 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316690 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.316942 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317040 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317205 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317291 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317506 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317612 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317832 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.317932 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318131 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318230 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318436 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318526 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318738 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.318851 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319055 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319154 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319340 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319438 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319639 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319742 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.319955 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.320054 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.320263 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.320859 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.321129 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:35:16.321222 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.321469 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.321570 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.321817 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.321920 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322149 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322242 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322464 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322565 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322779 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.322878 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323088 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323189 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323400 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323502 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323722 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.323813 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324028 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324125 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324336 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324435 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324643 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324735 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.324958 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325050 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325273 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325379 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325614 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325777 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.325927 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326016 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326367 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326486 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326575 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326656 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326845 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.326937 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327155 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327244 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327468 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327785 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.327889 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328091 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328419 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328505 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328733 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.328820 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329051 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329138 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329369 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329464 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329710 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.329817 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330022 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330115 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330329 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330421 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330636 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330730 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.330954 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331038 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331265 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331348 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331581 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331673 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331898 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.331982 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332208 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332295 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332514 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332607 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332818 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.332910 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333124 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333222 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333428 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333515 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333763 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.333861 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334080 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334166 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334400 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334492 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334712 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.334809 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335029 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335127 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335338 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335430 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335644 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335730 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.335971 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.336624 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.336816 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.336911 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337121 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337213 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337423 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337521 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337758 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.337912 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338060 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338148 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338370 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338465 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338681 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338766 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.338982 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339073 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339310 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339403 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339613 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339697 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.339921 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340007 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340229 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340323 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340536 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340620 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340838 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.340930 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341146 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341232 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341452 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341542 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341780 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.341879 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342092 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342179 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342397 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342484 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342700 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.342786 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343021 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343112 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343320 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343404 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343619 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343703 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.343928 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344021 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344232 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344329 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344536 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344637 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344843 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.344929 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345149 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345235 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345461 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345558 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345799 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.345887 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346110 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346207 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346429 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346523 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346746 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.346833 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347045 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347136 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347367 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347461 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347687 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.347773 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348001 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348097 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348300 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348396 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348604 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348690 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348904 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.348997 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349205 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349299 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349502 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349604 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349829 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.349915 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350127 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350213 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350429 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350516 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350728 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.350813 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351028 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351121 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351326 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351411 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351653 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351747 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.351961 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352057 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352260 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352345 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352560 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352654 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352861 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.352946 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353168 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353260 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353475 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353576 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353837 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.353939 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354144 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354236 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354507 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354621 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354791 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.354885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355099 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355196 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355411 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355504 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355719 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.355806 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356028 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356119 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356335 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356429 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356643 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356778 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.356953 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357038 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357257 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357349 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357573 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357686 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.357904 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358226 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358331 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358528 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358613 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358843 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.358929 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359142 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359236 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359454 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359541 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359758 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.359851 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360077 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360162 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360404 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360499 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360723 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.360817 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361030 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361116 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361342 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361427 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361650 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361809 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.361981 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362073 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362288 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362374 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362596 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362692 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362906 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.362991 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363210 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363294 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363527 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363612 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363829 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.363913 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364147 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364238 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364451 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364536 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364765 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.364851 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365065 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365150 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365373 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365467 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365690 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.365789 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366011 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366096 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366326 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366412 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366634 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366726 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.366950 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367035 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367301 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367446 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367591 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367692 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367895 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.367995 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368198 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368352 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368501 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368594 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368806 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.368905 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369111 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369415 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369503 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369752 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.369856 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370069 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370155 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370383 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370468 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370687 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370779 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.370989 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371071 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371288 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371372 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371591 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371749 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371898 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.371991 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372199 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372283 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372516 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372610 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372826 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.372912 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373126 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373210 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373426 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373519 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373769 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.373861 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374163 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374379 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374466 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374680 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374766 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.374982 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375289 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375373 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375600 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375693 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375906 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.375999 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.376223 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.376344 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.376541 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.376644 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.376852 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377016 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377167 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377254 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377478 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377563 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377813 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.377914 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378127 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378211 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378436 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378520 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378744 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.378838 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379052 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379144 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379360 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379445 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379670 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379756 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.379977 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380063 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380287 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380371 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380592 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380677 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380902 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.380988 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381210 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381300 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381515 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381600 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381850 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.381938 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.382156 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.382250 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.382470 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.382734 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.382819 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.383602 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.383890 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.383986 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384217 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384302 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384534 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384619 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384847 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.384950 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385171 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385257 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385497 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385581 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385858 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.385965 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386162 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386256 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386473 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386591 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386830 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.386923 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387149 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387245 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387461 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387554 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387764 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.387850 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388071 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388165 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388373 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388459 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388682 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388774 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.388983 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389088 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389283 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389370 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389583 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389687 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389910 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.389999 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.390215 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.390299 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.390792 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.390894 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.390986 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391067 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391145 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391223 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391410 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391498 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391713 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.391800 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392020 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392106 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392322 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392408 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392622 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392708 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.392927 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393019 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393235 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393329 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393566 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393651 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.393917 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394010 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394253 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394346 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394557 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394644 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394857 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.394942 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395270 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395476 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395570 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395776 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.395862 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396076 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396170 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396382 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396467 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396772 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.396985 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397072 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397292 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397376 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397601 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397732 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.397929 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.398017 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.398233 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.398418 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.399846 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400135 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400282 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400366 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400434 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400499 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400564 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400629 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400703 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400784 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.400784 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401051 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401122 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401202 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401282 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401350 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401457 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401541 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.401858 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402155 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402248 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402328 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402419 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402506 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402684 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402785 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.402984 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403076 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403272 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403359 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403570 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403665 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403873 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.403960 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404179 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404265 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404478 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404564 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404796 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.404889 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405102 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405188 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405399 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405485 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405718 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.405808 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406124 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406326 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406418 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406627 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406720 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.406933 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407020 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407245 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407331 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407554 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407639 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407853 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.407948 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408158 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408244 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408460 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408545 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408762 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.408856 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409064 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409150 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409369 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409453 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409707 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409808 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.409985 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410128 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410283 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410376 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410584 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410677 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410883 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.410969 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411188 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411273 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411489 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411618 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411789 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.411883 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412095 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412180 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412392 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412481 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412696 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.412780 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413003 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413088 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413352 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413439 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413650 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413780 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.413982 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414094 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414320 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414413 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414655 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414774 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.414977 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415101 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415299 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415413 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415614 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415700 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.415932 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416238 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416323 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416555 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416642 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416871 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.416966 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417167 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417251 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417484 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417576 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417814 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.417916 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418123 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418215 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418440 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418525 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418753 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.418851 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419068 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419152 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419367 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419452 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419672 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419807 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.419979 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420072 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420283 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420375 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420588 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420675 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420891 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.420977 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421198 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421283 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421505 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421592 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421836 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.421922 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422150 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422234 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422453 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422539 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422755 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.422840 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423058 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423153 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423363 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423449 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423664 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423749 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.423976 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424069 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424279 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424369 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424580 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424666 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424884 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.424982 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425186 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425271 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425491 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425575 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425815 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.425916 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426129 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426248 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426438 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426558 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426864 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.426949 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427165 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427250 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427469 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427555 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427775 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.427860 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428083 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428167 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428393 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428484 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428699 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.428787 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429016 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429101 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429325 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429410 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429739 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.429840 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430053 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430140 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430355 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430517 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430653 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430747 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.430956 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431041 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431275 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431375 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431575 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431660 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431874 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.431970 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432183 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432277 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432501 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432595 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432801 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.432886 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433210 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433423 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433527 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433778 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.433926 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434203 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434291 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434523 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434627 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434835 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.434928 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.435226 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.435311 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.435541 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.435634 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436111 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436203 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436428 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436727 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.436812 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437036 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437145 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437343 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437429 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437679 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437768 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.437993 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438091 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438299 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438384 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438609 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438696 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438909 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.438994 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439226 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439320 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439535 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439676 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439862 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.439995 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440188 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440282 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440501 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440595 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440828 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.440914 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441198 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441360 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441517 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441603 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441862 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.441963 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442170 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442259 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442471 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442556 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442776 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.442862 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443078 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443178 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443382 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443475 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443687 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443772 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.443989 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444081 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444299 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444391 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444605 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444689 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.444912 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.445058 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.445245 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.445877 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446055 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446143 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446363 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446451 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446661 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446746 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.446984 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447100 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447282 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447376 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447596 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447683 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.447909 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448003 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448208 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448293 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448526 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448612 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448831 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.448938 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449133 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449266 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449434 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449548 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449756 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.449860 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450066 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450152 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450373 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450503 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450685 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.450771 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451009 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451095 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451327 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451414 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451629 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451716 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.451956 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452042 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452275 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452360 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452591 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452677 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452904 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.452990 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453224 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453329 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453523 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453624 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453848 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.453937 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454155 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454253 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454457 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454548 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454755 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.454840 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455053 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455149 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455357 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455452 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455656 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455743 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.455955 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456050 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456254 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456340 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456558 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456642 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456863 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.456956 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457175 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457260 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457482 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457577 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457805 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.457903 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458109 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458195 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458406 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458492 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458713 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.458799 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459019 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459105 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459344 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459428 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459652 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459744 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.459963 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460049 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460286 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460381 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460591 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460677 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.460911 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.461608 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.461786 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.461887 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462100 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462184 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462514 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462625 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462731 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.462827 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463039 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463124 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463350 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463435 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463663 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463758 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.463969 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464056 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464283 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464375 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464593 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464686 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464904 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.464990 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.465217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.465459 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.465553 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.465813 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466101 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466187 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466425 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466520 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466737 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.466825 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467050 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467141 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467356 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467442 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467667 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467757 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.467978 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468063 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468282 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468377 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468590 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468684 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468900 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.468985 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469212 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469307 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469531 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469627 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469879 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.469966 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470193 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470327 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470507 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470594 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470820 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.470905 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471133 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471222 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471446 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471538 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471765 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.471851 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472070 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472384 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472473 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472698 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.472793 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473008 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473094 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473317 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473403 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473624 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473742 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.473962 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474047 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474270 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474354 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474578 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474674 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474885 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.474972 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475196 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475281 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475504 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475589 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475822 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.475915 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476138 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476223 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476454 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476540 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476791 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.476887 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477104 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477197 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477417 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477511 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477761 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.477962 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.478079 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.478272 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.478599 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.478684 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.478916 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479001 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479229 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479324 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479540 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479633 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479850 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.479944 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480170 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480263 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480469 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480555 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480770 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.480855 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481076 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481169 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481379 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481464 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481694 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.481792 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482013 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482100 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482318 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482403 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482624 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482710 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.482939 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483026 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483245 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483331 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483568 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483769 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.483868 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.484112 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.484401 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.484487 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.484729 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.484823 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485049 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485135 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485361 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485445 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485683 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.485785 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486009 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486102 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486313 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486399 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486615 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.486709 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487100 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487234 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487234 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487439 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487543 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487659 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487830 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.487919 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488136 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488223 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488443 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488530 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488756 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.488848 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489059 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489143 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489363 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489449 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489695 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.489787 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490002 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490086 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490304 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490392 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490607 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490693 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.490916 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491003 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491218 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491312 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491518 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491604 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491818 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.491917 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492118 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492229 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492450 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492543 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492748 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.492847 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493055 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493141 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493354 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493439 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493676 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493776 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.493991 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494077 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494298 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494383 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494602 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494696 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494914 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.494999 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495240 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495326 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495540 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495627 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495855 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.495948 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496162 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496248 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496480 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496566 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496787 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.496872 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497094 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497180 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497409 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497502 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497756 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.497844 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.498111 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.498287 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.498432 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.498620 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.498947 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499055 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499273 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499373 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499603 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499702 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499906 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.499998 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500210 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500376 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500514 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500651 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500866 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.500968 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501140 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501235 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501445 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501531 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501777 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.501879 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502089 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502187 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502397 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502532 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502709 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.502802 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503014 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503100 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503320 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503406 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503629 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503714 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.503932 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504017 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504237 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504324 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504543 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504630 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504849 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.504936 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505157 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505241 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505468 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505569 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505813 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.505902 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506128 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506215 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506438 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506537 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506752 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.506839 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507059 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507145 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507365 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507463 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507670 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.507757 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.508508 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.508598 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.508819 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.508913 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509133 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509225 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509438 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509523 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509761 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.509907 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510099 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510185 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510404 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510489 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510773 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.510859 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511088 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511174 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511394 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511489 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511713 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.511799 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512029 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512113 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512333 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512431 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512649 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512736 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.512959 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513044 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513281 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513381 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513595 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513701 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.513952 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514036 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514273 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514361 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514574 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514665 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514874 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.514960 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515172 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515259 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515475 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515561 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515785 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.515869 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516085 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516171 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516382 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516469 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516680 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516765 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.516982 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517279 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517364 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517578 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517740 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517902 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.517989 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518288 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518502 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518600 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518795 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.518889 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519091 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519177 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519388 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519483 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519685 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519771 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.519981 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520066 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520278 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520374 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520578 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520669 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520874 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.520959 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521173 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521261 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521470 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521556 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521792 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.521881 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522090 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522177 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522394 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522479 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522701 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.522793 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.523029 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.523114 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.523345 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.523430 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524187 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524289 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524503 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524592 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524807 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.524893 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525122 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525216 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525476 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525569 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525762 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.525865 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526068 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526163 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526410 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526555 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526699 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.526788 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527006 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527102 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527311 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527398 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527615 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527703 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.527924 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528081 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528224 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528312 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528531 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528618 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528846 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.528934 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529145 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529230 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529464 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529549 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529801 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.529900 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530120 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530206 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530430 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530520 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530737 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.530826 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531057 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531143 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531358 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531452 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531662 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531757 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.531973 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532059 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532277 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532372 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532581 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532668 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532888 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.532974 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533202 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533305 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533573 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533710 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533865 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.533955 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534195 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534283 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534525 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534619 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534836 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.534923 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535164 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535252 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535485 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535570 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535827 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.535923 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536140 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536233 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536448 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536533 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536756 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.536851 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.537056 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.537143 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.537297 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109909) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:35:16.537406 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.537737 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:35:16.537984 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109910) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:35:16.692370 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO dbcounter [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Registered counter for database nova_api Jun 24 08:35:16.697532 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO dbcounter [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Registered counter for database nova_api Jun 24 08:35:16.712616 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_db.sqlalchemy.engines [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.717476 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_db.sqlalchemy.engines [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.719861 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writer thread running {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.724150 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writer thread running {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.778401 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.context [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c923a23-3d41-45e5-8eb6-16c539602677(cell1) {{(pid=109909) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:35:16.781455 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.context [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c923a23-3d41-45e5-8eb6-16c539602677(cell1) {{(pid=109910) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:35:16.782345 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:35:16.783926 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:35:16.784707 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:35:16.785397 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_concurrency.lockutils [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:35:16.786766 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:35:16.787000 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_concurrency.lockutils [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:35:16.787771 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_concurrency.lockutils [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:35:16.788766 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO dbcounter [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Registered counter for database nova_cell0 Jun 24 08:35:16.789747 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_concurrency.lockutils [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109910) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:35:16.791856 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO dbcounter [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Registered counter for database nova_cell0 Jun 24 08:35:16.792906 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO dbcounter [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Registered counter for database nova_cell1 Jun 24 08:35:16.795864 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO dbcounter [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Registered counter for database nova_cell1 Jun 24 08:35:16.802175 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_db.sqlalchemy.engines [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.803908 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_db.sqlalchemy.engines [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.804228 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_db.sqlalchemy.engines [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.807727 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_db.sqlalchemy.engines [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.810230 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writer thread running {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.811859 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writer thread running {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.813115 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writer thread running {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.952918 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writer thread running {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.958954 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO dbcounter [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Registered counter for database nova_cell0 Jun 24 08:35:16.962117 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO dbcounter [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Registered counter for database nova_cell0 Jun 24 08:35:16.967950 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_db.sqlalchemy.engines [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109909) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.971350 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG oslo_db.sqlalchemy.engines [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109910) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:35:16.972604 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writer thread running {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:16.975904 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writer thread running {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:35:17.315640 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: WARNING keystonemiddleware.auth_token [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:35:17.316265 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: WARNING keystonemiddleware.auth_token [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:35:17.323473 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: WARNING keystonemiddleware.auth_token [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:35:17.323973 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: WARNING keystonemiddleware.auth_token [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:35:17.665652 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: WARNING keystonemiddleware.auth_token [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:35:17.671590 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: WARNING keystonemiddleware.auth_token [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:35:17.673705 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: WARNING keystonemiddleware.auth_token [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:35:17.676842 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1e02169c0 pid: 109909 (default app) Jun 24 08:35:17.678968 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:35:17.679572 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: WARNING keystonemiddleware.auth_token [None req-7f9e0bf0-c57a-4dd4-901c-97cd74fd5fe3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:35:17.680714 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jun 24 08:35:17.681131 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri Jun 24 08:35:17 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:35:17.685581 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c1e02169c0 pid: 109910 (default app) Jun 24 08:36:34.545251 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:34.546423 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Jun 24 08:36:34.546918 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:34.564358 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_api:SELECT=3 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:34.566089 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_cell0:SELECT=3 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:34.568593 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_cell1:SELECT=3 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:34.571662 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:35.015531 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-5052e3a5-b58d-48cd-8e00-3a01ef0c8b2d admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:35.045220 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-5052e3a5-b58d-48cd-8e00-3a01ef0c8b2d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.488505 Jun 24 08:36:35.048351 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 24 08:36:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:37.159414 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:37.160424 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-c330028c-16c6-40c4-9e47-db580535f3e4 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 24 08:36:37.160817 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:37.224882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-cbda7909-3e14-4d69-8450-2593551a5709 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "cirros256", "swap": 0, "ram": 256}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:37.243435 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:36:37.243435 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: warnings.warn(msg) Jun 24 08:36:37.275204 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-cbda7909-3e14-4d69-8450-2593551a5709 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108309 Jun 24 08:36:37.276991 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:36:37.289259 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_api:SELECT=3 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:37.290373 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_cell1:SELECT=3 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:37.291697 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_cell0:SELECT=3 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:37.293785 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:37.509748 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a0561aa9-4d80-48b8-b98c-dd5514331092 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:37.512739 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:36:37.512739 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:36:37.576220 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-a0561aa9-4d80-48b8-b98c-dd5514331092 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291934 Jun 24 08:36:37.577913 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 24 08:36:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:39.687302 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-cbda7909-3e14-4d69-8450-2593551a5709 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:39.688940 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-cbda7909-3e14-4d69-8450-2593551a5709 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002178 Jun 24 08:36:39.691412 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:39.813600 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-236bd18a-da3d-4208-90fb-6d64ad9b001e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:39.832090 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:36:39.832090 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:36:39.850531 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-236bd18a-da3d-4208-90fb-6d64ad9b001e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154265 Jun 24 08:36:39.851454 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:36:39.863117 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54e38d3-c035-4c07-a89a-33e1a87583e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:39.864625 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:36:39.864625 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: warnings.warn(msg) Jun 24 08:36:39.897084 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54e38d3-c035-4c07-a89a-33e1a87583e5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037659 Jun 24 08:36:39.897933 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 24 08:36:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-236bd18a-da3d-4208-90fb-6d64ad9b001e admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:41.987432 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-236bd18a-da3d-4208-90fb-6d64ad9b001e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 24 08:36:41.987843 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:42.059867 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4077796b-eefe-4451-809a-44ef658becde admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:42.080748 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-4077796b-eefe-4451-809a-44ef658becde admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086931 Jun 24 08:36:42.085755 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:36:42.094602 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-88d86981-5645-44b1-bbc8-27f4e86924e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:42.119383 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-88d86981-5645-44b1-bbc8-27f4e86924e2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029039 Jun 24 08:36:42.120026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 24 08:36:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:44.222313 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4077796b-eefe-4451-809a-44ef658becde admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:44.223322 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-4077796b-eefe-4451-809a-44ef658becde admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 24 08:36:44.223897 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:44.284229 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-47c6d405-ec2d-439f-a250-2862ffab7418 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:44.302066 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-47c6d405-ec2d-439f-a250-2862ffab7418 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071978 Jun 24 08:36:44.302610 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:36:44.315244 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-18571b14-a9ac-44bb-9f1f-f598492cf302 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:44.343144 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-18571b14-a9ac-44bb-9f1f-f598492cf302 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031572 Jun 24 08:36:44.343725 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 24 08:36:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:46.478530 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-47c6d405-ec2d-439f-a250-2862ffab7418 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:46.479555 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-47c6d405-ec2d-439f-a250-2862ffab7418 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 24 08:36:46.480186 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:46.555421 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "name": "ds4G"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:46.575500 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087571 Jun 24 08:36:46.576096 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:36:46.589755 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-9054a37c-854f-4482-8238-09c6da986e96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:46.615278 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-9054a37c-854f-4482-8238-09c6da986e96 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029241 Jun 24 08:36:46.616046 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri Jun 24 08:36:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:36:48.735754 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:48.736792 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 24 08:36:48.737193 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:48.800868 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-71f1c74b-fcce-4626-9bb7-008cc0efb656 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:48.825761 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-71f1c74b-fcce-4626-9bb7-008cc0efb656 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082341 Jun 24 08:36:48.826463 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 24 08:36:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:36:50.969244 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:50.970934 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-855211b3-fb5f-4897-9480-4e493d8fc171 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002045 Jun 24 08:36:50.971279 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:51.058060 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-0e93de6f-de29-4bcc-a01b-9ef8d13c479a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:51.106820 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-0e93de6f-de29-4bcc-a01b-9ef8d13c479a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128000 Jun 24 08:36:51.108517 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:50 2022] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:36:51.126114 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b7a7b2a4-0e5f-4f54-8668-95319be4a04f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:51.157655 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b7a7b2a4-0e5f-4f54-8668-95319be4a04f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040004 Jun 24 08:36:51.158285 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 24 08:36:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:36:53.297416 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-0e93de6f-de29-4bcc-a01b-9ef8d13c479a admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:53.298484 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-0e93de6f-de29-4bcc-a01b-9ef8d13c479a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jun 24 08:36:53.298877 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:36:53.382572 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-7ab860fb-17c4-437f-b59e-3dcefdef67eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:53.405026 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-7ab860fb-17c4-437f-b59e-3dcefdef67eb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.099872 Jun 24 08:36:53.405593 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:36:53.420955 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-1931abcb-c7fc-47d6-99c0-0f9c951c3d09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:53.452701 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-1931abcb-c7fc-47d6-99c0-0f9c951c3d09 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037461 Jun 24 08:36:53.454318 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 24 08:36:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:36:55.580542 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-7ab860fb-17c4-437f-b59e-3dcefdef67eb admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:55.581449 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-7ab860fb-17c4-437f-b59e-3dcefdef67eb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 24 08:36:55.581893 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:36:55.643356 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-45a66c1d-ba1e-4a9c-a94b-64bff681437e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "id": "3", "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:55.663108 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-45a66c1d-ba1e-4a9c-a94b-64bff681437e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075274 Jun 24 08:36:55.663731 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:36:55.675641 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2224f9b8-e689-4d87-920f-1e9cd5ab1f13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:55.698619 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2224f9b8-e689-4d87-920f-1e9cd5ab1f13 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026654 Jun 24 08:36:55.699202 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 24 08:36:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:36:57.855384 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-45a66c1d-ba1e-4a9c-a94b-64bff681437e admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:36:57.856936 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-45a66c1d-ba1e-4a9c-a94b-64bff681437e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 24 08:36:57.857338 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:36:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:36:57.916829 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-9eeccba8-2e33-4587-b32b-7f6d471985a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:57.936674 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-9eeccba8-2e33-4587-b32b-7f6d471985a3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073250 Jun 24 08:36:57.937228 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:36:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:36:57.949506 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-387ff2e7-901e-4a63-b9e8-d8d7324a9bcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:36:57.973622 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-387ff2e7-901e-4a63-b9e8-d8d7324a9bcc admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027907 Jun 24 08:36:57.974235 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 24 08:36:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:37:00.099912 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-9eeccba8-2e33-4587-b32b-7f6d471985a3 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:00.101056 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-9eeccba8-2e33-4587-b32b-7f6d471985a3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 24 08:37:00.101457 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:00.160186 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:00.178714 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070171 Jun 24 08:37:00.179382 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri Jun 24 08:37:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:37:00.191945 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-ee039ae7-8c61-48bb-ac86-df34728d9ede admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:00.215239 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-ee039ae7-8c61-48bb-ac86-df34728d9ede admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026989 Jun 24 08:37:00.215849 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri Jun 24 08:37:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:37:25.221286 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:25.222333 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 24 08:37:25.222759 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:25.234277 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:25.283225 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-6c80b7d1-cd64-49c8-98ee-b4e63e09bd66 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:25.300802 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-6c80b7d1-cd64-49c8-98ee-b4e63e09bd66 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071856 Jun 24 08:37:25.301352 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 24 08:37:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:26.225863 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:26.226961 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-7b9a931d-adb5-48f5-9efc-0b966881fa04 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jun 24 08:37:26.227433 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:26.418841 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4b69f670-7bb1-428a-a898-6426a35c420d admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:26.424948 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.wsgi [None req-4b69f670-7bb1-428a-a898-6426a35c420d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4b69f670-7bb1-428a-a898-6426a35c420d admin admin] Request method failure captured: Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept: application/json Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept-Encoding: gzip, deflate Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Connection: keep-alive Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Content-Length: 0 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Host: 10.222.0.48 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-System-Scope: None Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: User-Agent: python-novaclient Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Auth-Token: gAAAAABitXfGE108I3Zbqk5DFNj8Wayq8YQpmIMcT2HswivZIThuc7FS0NQ0EwAoiazPIm7knEf86mVZFUtLcxI5TVhB5Xd-A1OzOrILh29rnUtqCFS-qw-YFP1EdR_OQRJooDQ0PMtVvSoz_TBY9ZEbWSYGVlJccPjWyjk1g5rJyDsO9-fDJmo Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Id: None Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Name: None Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Identity-Status: Confirmed Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Is-Admin-Project: True Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Id: default Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Name: Default Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Name: admin Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Role: admin,reader,member Jun 24 08:37:26.428217 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Roles: admin,reader,member Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant: admin Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Name: admin Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User: admin Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Id: default Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Name: Default Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Name: admin Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: method: > Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: exception: Flavor 42 could not be found. Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: action_args: {'id': '42'} Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:26.429882 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:26.430760 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.431885 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4b69f670-7bb1-428a-a898-6426a35c420d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:26.432909 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-4b69f670-7bb1-428a-a898-6426a35c420d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063181 Jun 24 08:37:26.432909 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 24 08:37:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:26.439880 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-33648a8b-adf3-4ac1-9ff3-fd6cda3c6733 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:26.442851 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:26.462649 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-33648a8b-adf3-4ac1-9ff3-fd6cda3c6733 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026867 Jun 24 08:37:26.463137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:26.473088 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4b21c90b-1268-4bc3-a033-5aa4a095de43 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:26.496126 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-4b21c90b-1268-4bc3-a033-5aa4a095de43 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026668 Jun 24 08:37:26.496712 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:26.506832 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a4fa80ea-9c29-4118-95f8-e96bf29628f3 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:26.513207 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.wsgi [None req-a4fa80ea-9c29-4118-95f8-e96bf29628f3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a4fa80ea-9c29-4118-95f8-e96bf29628f3 admin admin] Request method failure captured: Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept: application/json Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept-Encoding: gzip, deflate Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Connection: keep-alive Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Content-Length: 0 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Host: 10.222.0.48 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-System-Scope: None Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: User-Agent: python-novaclient Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Auth-Token: gAAAAABitXfGE108I3Zbqk5DFNj8Wayq8YQpmIMcT2HswivZIThuc7FS0NQ0EwAoiazPIm7knEf86mVZFUtLcxI5TVhB5Xd-A1OzOrILh29rnUtqCFS-qw-YFP1EdR_OQRJooDQ0PMtVvSoz_TBY9ZEbWSYGVlJccPjWyjk1g5rJyDsO9-fDJmo Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Id: None Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Name: None Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Identity-Status: Confirmed Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Is-Admin-Project: True Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Id: default Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Name: Default Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Name: admin Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Role: admin,reader,member Jun 24 08:37:26.516571 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Roles: admin,reader,member Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant: admin Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Name: admin Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User: admin Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Id: default Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Name: Default Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Name: admin Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: method: > Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: exception: Flavor 42 could not be found. Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: action_args: {'id': '42'} Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:26.518116 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:26.519137 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:26.520480 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a4fa80ea-9c29-4118-95f8-e96bf29628f3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:26.521747 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-a4fa80ea-9c29-4118-95f8-e96bf29628f3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014723 Jun 24 08:37:26.521747 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 24 08:37:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:27.353247 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-4b21c90b-1268-4bc3-a033-5aa4a095de43 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:27.354328 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-4b21c90b-1268-4bc3-a033-5aa4a095de43 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 24 08:37:27.354732 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:27.545056 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-498ee1de-7500-49e5-92e3-d3142c6542bb admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:27.552950 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.wsgi [None req-498ee1de-7500-49e5-92e3-d3142c6542bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-498ee1de-7500-49e5-92e3-d3142c6542bb admin admin] Request method failure captured: Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept: application/json Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept-Encoding: gzip, deflate Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Connection: keep-alive Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Content-Length: 0 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Host: 10.222.0.48 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-System-Scope: None Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: User-Agent: python-novaclient Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Auth-Token: gAAAAABitXfHg2UhFIeVNFBwQ3reLNfwPkxjrzycjVY1CO3JDq1frICnLgPrR6mQFoOPFIabjVsYPRB-JQCsy2NIgdnrNaOybL2n4t030XznA6a26YS73kIcOEyBbSPzr-OLeQ83Nc0H5I_qi7CfNWc_QVSJxLMO5mUXOapWhJG7yfJrGRRSS1M Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Id: None Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Name: None Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Identity-Status: Confirmed Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Is-Admin-Project: True Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Id: default Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Name: Default Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Name: admin Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Role: admin,reader,member Jun 24 08:37:27.554513 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Roles: admin,reader,member Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant: admin Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Name: admin Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User: admin Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Id: default Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Name: Default Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Name: admin Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: method: > Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: exception: Flavor 84 could not be found. Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: action_args: {'id': '84'} Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:27.556026 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:27.556878 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.557996 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-498ee1de-7500-49e5-92e3-d3142c6542bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:27.559255 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-498ee1de-7500-49e5-92e3-d3142c6542bb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063130 Jun 24 08:37:27.559255 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 24 08:37:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 08:37:27.566474 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b6185193-006c-4750-8cab-a14233128bc5 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:27.580823 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b6185193-006c-4750-8cab-a14233128bc5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018194 Jun 24 08:37:27.581361 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:27.591112 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-7f1c98b5-d019-4b55-bf0f-c91e55b3caf8 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:27.604875 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-7f1c98b5-d019-4b55-bf0f-c91e55b3caf8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017327 Jun 24 08:37:27.605450 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:27.615121 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-ec5368c6-369a-4f45-a1cb-9b1562fd4d42 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:27.620480 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.wsgi [None req-ec5368c6-369a-4f45-a1cb-9b1562fd4d42 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-ec5368c6-369a-4f45-a1cb-9b1562fd4d42 admin admin] Request method failure captured: Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept: application/json Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept-Encoding: gzip, deflate Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Connection: keep-alive Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Content-Length: 0 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Host: 10.222.0.48 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-System-Scope: None Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: User-Agent: python-novaclient Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Auth-Token: gAAAAABitXfHg2UhFIeVNFBwQ3reLNfwPkxjrzycjVY1CO3JDq1frICnLgPrR6mQFoOPFIabjVsYPRB-JQCsy2NIgdnrNaOybL2n4t030XznA6a26YS73kIcOEyBbSPzr-OLeQ83Nc0H5I_qi7CfNWc_QVSJxLMO5mUXOapWhJG7yfJrGRRSS1M Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Id: None Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Name: None Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Identity-Status: Confirmed Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Is-Admin-Project: True Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Id: default Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Name: Default Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Name: admin Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Role: admin,reader,member Jun 24 08:37:27.622014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Roles: admin,reader,member Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant: admin Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Name: admin Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User: admin Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Id: default Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Name: Default Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Name: admin Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: method: > Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: exception: Flavor 84 could not be found. Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: action_args: {'id': '84'} Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:27.624075 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:27.625015 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:27.626297 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-ec5368c6-369a-4f45-a1cb-9b1562fd4d42 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:27.627556 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-ec5368c6-369a-4f45-a1cb-9b1562fd4d42 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011891 Jun 24 08:37:27.627556 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri Jun 24 08:37:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:28.454788 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-7f1c98b5-d019-4b55-bf0f-c91e55b3caf8 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:28.455803 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-7f1c98b5-d019-4b55-bf0f-c91e55b3caf8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 24 08:37:28.456204 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:28.649396 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-35c7d82d-b69f-48de-a17b-5e9f5d3e2085 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:28.655440 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.wsgi [None req-35c7d82d-b69f-48de-a17b-5e9f5d3e2085 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-35c7d82d-b69f-48de-a17b-5e9f5d3e2085 admin admin] Request method failure captured: Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept: application/json Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Accept-Encoding: gzip, deflate Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Connection: keep-alive Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Content-Length: 0 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Host: 10.222.0.48 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Openstack-System-Scope: None Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: User-Agent: python-novaclient Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Auth-Token: gAAAAABitXfI_XaHu_jG-ZlS42oe7nb3LESmztKZ4Tf9rGtetzA1i5s1xY_Q8LMit0dxZ_fck3QZ7OSPJhGtvj1rG31yeGjtXCCXvhXHeesIG7QRQXAmhGIosBJkaQ_jgEoeK5_75keZQOd4UQlbEUVl73YTROlJkwCrokpXQDnQOgPrq2z_OaM Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Id: None Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Domain-Name: None Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Identity-Status: Confirmed Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Is-Admin-Project: True Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Id: default Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Domain-Name: Default Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Project-Name: admin Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Role: admin,reader,member Jun 24 08:37:28.656974 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Roles: admin,reader,member Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant: admin Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-Tenant-Name: admin Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User: admin Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Id: default Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Domain-Name: Default Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: X-User-Name: admin Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: method: > Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: exception: Flavor 451 could not be found. Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: action_args: {'id': '451'} Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:28.658380 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:28.659179 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.660199 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-35c7d82d-b69f-48de-a17b-5e9f5d3e2085 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109910) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:28.661176 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-35c7d82d-b69f-48de-a17b-5e9f5d3e2085 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062474 Jun 24 08:37:28.661176 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:37:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:28.668345 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-98448713-e313-4fa0-97ea-fa8e0f00025b admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:28.682844 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-98448713-e313-4fa0-97ea-fa8e0f00025b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018010 Jun 24 08:37:28.683426 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:28.693756 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:28.714068 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023910 Jun 24 08:37:28.714639 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri Jun 24 08:37:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:37:28.724204 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-e0ad9240-dbb1-44e5-8995-17d049514461 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:28.729655 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.wsgi [None req-e0ad9240-dbb1-44e5-8995-17d049514461 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-e0ad9240-dbb1-44e5-8995-17d049514461 admin admin] Request method failure captured: Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept: application/json Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Accept-Encoding: gzip, deflate Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Connection: keep-alive Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Content-Length: 0 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Host: 10.222.0.48 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-Api-Version: compute 2.90 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Openstack-System-Scope: None Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: User-Agent: python-novaclient Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Auth-Token: gAAAAABitXfI_XaHu_jG-ZlS42oe7nb3LESmztKZ4Tf9rGtetzA1i5s1xY_Q8LMit0dxZ_fck3QZ7OSPJhGtvj1rG31yeGjtXCCXvhXHeesIG7QRQXAmhGIosBJkaQ_jgEoeK5_75keZQOd4UQlbEUVl73YTROlJkwCrokpXQDnQOgPrq2z_OaM Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Id: None Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Domain-Name: None Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Identity-Status: Confirmed Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Is-Admin-Project: True Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Id: default Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Domain-Name: Default Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Project-Name: admin Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Role: admin,reader,member Jun 24 08:37:28.731176 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Roles: admin,reader,member Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9c6ba757b5864f7d9437f8f4c1023194"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant: admin Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Id: 9c6ba757b5864f7d9437f8f4c1023194 Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-Tenant-Name: admin Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User: admin Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Id: default Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Domain-Name: Default Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Id: 5027404f8c2d4b2eb9144770e041deb9 Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: X-User-Name: admin Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: method: > Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: exception: Flavor 451 could not be found. Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: action_args: {'id': '451'} Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:37:28.732686 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:28.734201 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: ERROR nova.api.openstack.wsgi Jun 24 08:37:28.735462 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-e0ad9240-dbb1-44e5-8995-17d049514461 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109909) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:37:28.736880 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-e0ad9240-dbb1-44e5-8995-17d049514461 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011952 Jun 24 08:37:28.736880 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:37:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:29.568604 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:29.569619 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 24 08:37:29.570050 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:29.762079 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-75ed33d9-a807-42ad-b465-78a50e0d0f6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:29.781057 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-75ed33d9-a807-42ad-b465-78a50e0d0f6e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072305 Jun 24 08:37:29.781605 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 24 08:37:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:37:30.612301 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:30.613311 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 24 08:37:30.613729 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:30.809614 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a3b52544-7291-4d7a-8ac8-877ba6b68613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:30.828796 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-a3b52544-7291-4d7a-8ac8-877ba6b68613 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077143 Jun 24 08:37:30.829293 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 24 08:37:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:37:31.659701 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:31.660714 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 24 08:37:31.661111 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:31.851993 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-76ebb1cc-ff32-4815-ac83-ee1f04ab1f4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:31.870079 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-76ebb1cc-ff32-4815-ac83-ee1f04ab1f4c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070768 Jun 24 08:37:31.870550 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 24 08:37:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:37:32.703226 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:32.704228 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 24 08:37:32.704627 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:32.903394 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-010bcc90-9fed-4603-80ff-4886da51833c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:37:32.921190 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-010bcc90-9fed-4603-80ff-4886da51833c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070742 Jun 24 08:37:32.921778 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri Jun 24 08:37:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:37:33.756574 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:33.757581 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 08:37:33.758014 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:37:33.953735 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-2f558c42-5733-445e-9c5e-5fbb5df83d88 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:37:33.978535 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-2f558c42-5733-445e-9c5e-5fbb5df83d88 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081906 Jun 24 08:37:33.979084 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri Jun 24 08:37:33 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:38:21.001965 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.002972 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-b54d1a66-2d30-4960-84c2-a2a51d5d2ece admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Jun 24 08:38:21.003394 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri Jun 24 08:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:38:21.013545 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:21.061341 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-30e1b3d1-f7f1-427a-896a-95e77afde692 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.081239 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-30e1b3d1-f7f1-427a-896a-95e77afde692 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072203 Jun 24 08:38:21.081803 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri Jun 24 08:38:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:38:21.104475 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-ae66f2a2-d3b0-4ba8-807e-af9f2a9dd762 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.107973 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG dbcounter [-] [109910] Writing DB stats nova_api:SELECT=14 {{(pid=109910) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:21.114266 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-ae66f2a2-d3b0-4ba8-807e-af9f2a9dd762 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013339 Jun 24 08:38:21.114817 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 24 08:38:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:38:21.126957 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-a3ab6814-aa0d-4c94-a691-3de3bbacc4fe admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.134840 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-a3ab6814-aa0d-4c94-a691-3de3bbacc4fe admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012064 Jun 24 08:38:21.135376 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 24 08:38:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:38:21.147135 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.154700 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011161 Jun 24 08:38:21.155226 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri Jun 24 08:38:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:38:21.166237 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-2f118152-f90c-438c-a635-5b5e358f4018 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:38:21.174302 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-2f118152-f90c-438c-a635-5b5e358f4018 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011555 Jun 24 08:38:21.174819 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri Jun 24 08:38:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:41:34.898523 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:34.899530 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 24 08:41:34.899921 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:35.041616 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_api:SELECT=6 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:35.159602 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:35.160767 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:41:35.160767 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:41:35.162020 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.162485 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.163297 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:35.163719 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:35.197029 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-5c461de2-04de-4532-99b5-44a6d67330d7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156828 Jun 24 08:41:35.197608 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:41:35 2022] GET /compute/v2.1/os-services => generated 794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:41:36.032849 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:36.034040 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002109 Jun 24 08:41:36.034514 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:36.230844 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:36.232019 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:41:36.232019 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:41:36.233248 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.233694 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.234467 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:36.234897 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:36.255278 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-bb20af7f-a049-4559-932c-2af1c4c2f803 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075873 Jun 24 08:41:36.255760 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:41:36 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:41:47.559490 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.560499 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 24 08:41:47.560894 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:47.708504 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_cell0:SELECT=4 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:47.709252 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_cell1:SELECT=4 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:47.709904 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG dbcounter [-] [109909] Writing DB stats nova_api:SELECT=8 {{(pid=109909) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:47.763984 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:47.765160 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:41:47.765160 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:41:47.766381 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.766823 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.767626 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:47.768053 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:47.792870 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-6a142aef-864c-416d-a82e-ac0a170cc400 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090136 Jun 24 08:41:47.793427 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:41:47 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:41:48.640853 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: DEBUG nova.api.openstack.wsgi [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] Calling method '>' {{(pid=109910) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.641929 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: INFO nova.api.openstack.requestlog [None req-2546e99d-a348-4ce1-9cd0-351cec7e3933 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 24 08:41:48.642821 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: [pid: 109910|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri Jun 24 08:41:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:41:48.836672 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG nova.api.openstack.wsgi [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] Calling method '>' {{(pid=109909) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:41:48.838007 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:41:48.838007 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: warnings.warn(msg) Jun 24 08:41:48.839299 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.839736 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.840515 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:41:48.840937 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: DEBUG oslo_concurrency.lockutils [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109909) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:41:48.862739 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: INFO nova.api.openstack.requestlog [None req-4827fd5c-673e-4b15-adf7-d8d58e0b3361 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079692 Jun 24 08:41:48.863220 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: [pid: 109909|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri Jun 24 08:41:48 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:42:47.549801 dv-cinder-787296-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 08:42:47.550733 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: Fri Jun 24 08:42:47 2022 - graceful shutdown triggered... Jun 24 08:42:47.551410 dv-cinder-787296-12-iscsi devstack@n-api.service[109909]: Gracefully killing worker 1 (pid: 109909)... Jun 24 08:42:47.552077 dv-cinder-787296-12-iscsi devstack@n-api.service[109910]: Gracefully killing worker 2 (pid: 109910)... Jun 24 08:42:48.551921 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: worker 1 buried after 1 seconds Jun 24 08:42:48.551921 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: worker 2 buried after 1 seconds Jun 24 08:42:48.551921 dv-cinder-787296-12-iscsi devstack@n-api.service[109908]: goodbye to uWSGI. Jun 24 08:42:48.553983 dv-cinder-787296-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 08:42:48.554850 dv-cinder-787296-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 08:42:48.558230 dv-cinder-787296-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 08:42:48.569694 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 08:42:48.572387 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:42:48 2022] *** Jun 24 08:42:48.573334 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:42:48.573496 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:42:48.573620 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: nodename: dv-cinder-787296-12-iscsi Jun 24 08:42:48.573757 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: machine: x86_64 Jun 24 08:42:48.573869 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: clock source: unix Jun 24 08:42:48.574003 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: pcre jit disabled Jun 24 08:42:48.574115 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: detected number of CPU cores: 4 Jun 24 08:42:48.574216 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: current working directory: / Jun 24 08:42:48.574308 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:42:48.574415 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: your processes number limit is 47680 Jun 24 08:42:48.574526 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: your memory page size is 4096 bytes Jun 24 08:42:48.574776 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: detected max file descriptor number: 2048 Jun 24 08:42:48.574909 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: lock engine: pthread robust mutexes Jun 24 08:42:48.575350 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: thunder lock: enabled Jun 24 08:42:48.575676 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 08:42:48.575877 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:42:48.635157 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: Python main interpreter initialized at 0x55fa0a8de9c0 Jun 24 08:42:48.635157 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: python threads support enabled Jun 24 08:42:48.635157 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: your server socket listen backlog is limited to 100 connections Jun 24 08:42:48.635157 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:42:48.635779 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:42:48.635779 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: *** Operational MODE: preforking *** Jun 24 08:42:48.636033 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:42:48.636033 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: spawned uWSGI master process (pid: 124387) Jun 24 08:42:48.636254 dv-cinder-787296-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 08:42:48.637619 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: spawned uWSGI worker 1 (pid: 124404, cores: 1) Jun 24 08:42:48.646336 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: spawned uWSGI worker 2 (pid: 124405, cores: 1) Jun 24 08:42:48.646723 dv-cinder-787296-12-iscsi devstack@n-api.service[124387]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:42:49.351761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:42:49.454443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 08:42:50.597224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:42:50.597224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: from cryptography.utils import int_from_bytes Jun 24 08:42:50.598411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:42:50.598411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: from cryptography.utils import int_from_bytes Jun 24 08:42:50.672280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:42:50.672280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: from cryptography.utils import int_from_bytes Jun 24 08:42:50.673047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:42:50.673047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: from cryptography.utils import int_from_bytes Jun 24 08:42:53.208966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:42:53.210349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:42:53.211513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:42:53.212373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:42:53.213003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:42:53.213897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.214675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.215444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.216229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.217016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.217781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.218494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.219067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.219584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.220010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.220536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.221078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-12-iscsi {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.221613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.222163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.222689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.223226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.223744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.225062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.225567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.226425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.228889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.229364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.229890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.230428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.230934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.231389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.231921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.232437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.232994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.233532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.234251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-12-iscsi {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.234800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.235336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.235900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.236642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.237196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.237790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.238367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.238945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.239499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.241109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.244558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.244558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.244558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.244558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.244558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.246791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.251118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.251889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.252215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.252650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.253291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.253824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.254186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.254656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.254961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.255266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.255603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.255866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.256267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.256625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.256955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.257278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.257646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.258053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.258436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.258845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.259185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.259792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.260066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.260331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.260585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.261354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.261354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.261920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.261920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.262391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.262638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.262868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.263622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.263826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.264130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.264448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.264779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.265127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.265453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.265754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.266037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.266355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.266685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.267000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.267316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.267632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.267928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.268331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.268781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.269324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.269578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.269934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.270162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.270673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.270896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.271155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.271470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.271688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.272599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.272599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.272599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.273266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.273498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.273738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.274050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.274381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.274699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.275012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.275341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.275676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.275992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.276318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.276628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.277068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.277306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.277536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.277880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.278193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.278606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.278831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.279103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.279608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.279827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.280047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.280299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.280877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.281109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.281332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.281561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.281882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.282311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.283051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.283051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.283487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.283702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.283931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.284157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.284476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.285005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.285237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.285501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.285845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.286231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.286559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.287418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.287761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.288148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.288429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.288803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.289047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.289541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.290014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.290248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.290470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.291098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.291327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.291558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.291862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.292210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.292723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.293142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.293749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.293749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.294420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.294420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.294869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.295085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.295299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.295816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.296011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.296428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.296783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.297193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.297530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.298045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.298439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.298933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.299232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.299616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.299919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.300329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.300662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.301284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.301517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.301916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.302154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.303306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.303592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.304219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.304455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.304698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.304926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.305310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.305639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.306044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.306322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.306663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.306984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.307301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.307633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.308097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.308454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.308788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.309185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.309518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.309869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.310181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.310578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.310829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.311147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.311760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.311998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.312208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.312448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.312759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.313170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.313989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.313989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.314785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.314785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.314785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.315345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.315564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.315786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.316167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.316461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.316780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.317214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.317536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.318157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.318368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.318564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.318858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.319284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.319857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.320186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.320667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.320877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.321151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.321473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.322037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.322193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.322478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.322782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.323103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.324124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.324124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.324124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.325124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.325124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.325124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.325520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.325695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.326025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.326536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.326811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.326975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.327302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.327618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.327934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.328253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.328572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.328900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.329587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.329587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.330105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.330344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.330590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.330965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.331188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.331416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.331753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.332328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.332556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.332772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.333027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.333346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.333714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.334352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.334352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.334816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.335437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.335437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.335880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.336111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.336267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.336697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.336845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.337153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.337463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.338010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.338245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.338474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.338768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.339098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.339410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.339824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.340062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.340346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.340657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.341073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.341323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.341622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.341969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.342528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.342752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.342977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.343222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.343549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.343862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.344361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.344525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.344887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.345200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.345803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.345957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.346200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.346520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.346857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.347237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.347558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.347876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.348191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.348512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.348839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.350389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.350677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.351010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.351398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.351673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.352008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.352687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.352687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.353121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.353361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.353717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.354040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.354508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.354739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.355150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.355407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.355671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.356294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.356294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.356673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.356834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.357102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.357528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.357817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.358065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.358475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.358717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.359017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.359332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.359649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.359961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.360386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.360639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.360960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.361299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.361844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.362086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.362337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.362608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.363177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.363177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.363650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.363899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.366838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.368461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.368461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.368461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.368461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.369556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.369556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.369556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.370271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.370271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.370917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.370917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.371399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.371664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.372052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.372297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.372573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.372817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.373438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.373438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.374174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.374174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.374669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.374669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.375129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.375363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.375595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.376215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.376215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.377352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.377352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.377352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.378079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.378079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.378079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.378777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.378777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.379369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.379369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.379960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.379960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.380431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.380889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.380889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.381354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.381601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.381887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.382286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.382504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.382761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.383092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.383648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.383894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.384120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.384355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.384617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.384936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.385314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.385629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.386541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.386541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.387050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.387050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.387889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.387889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.387889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.388567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.388567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.389060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.389338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.389580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.389876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.390122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.390453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.390774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.391167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.391402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.391700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.392108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.392522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.392771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.393189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.393740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.393933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.394226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.394644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.395051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.395376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.395831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.396197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.396513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.396924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.397357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.397798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.398202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.398604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.398922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.399364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.399681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.399999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.400318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.400657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.400968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.401314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.401606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.401989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.402245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.402544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.402903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.403262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.403605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.404107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.404522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.404852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.405380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.405842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.406058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.406725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.406725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.408939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.410288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.410653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.411013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.411387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.412276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.412614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.412950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.413422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.414164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.414164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.414515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.414842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.415159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.415476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.416606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.416606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.416606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.416985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.417138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.417439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.419801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.419801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.420208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.420386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.420606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.420944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.421586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.421586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.421998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.422569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.422827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.423081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.423347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.423593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.424220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.424220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.424695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.425170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.425406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.425631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.425926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.427160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.427160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.427160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.428417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.428707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.429053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.429403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.429743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.430068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.430389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.430703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.431021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.431339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.431653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.431965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.432276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.432609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.432926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.433255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.433576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.433915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.435818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.436149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.436488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.436808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.437140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.437469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.437822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.438148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.438563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.438854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.439176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.439501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.439817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.440143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.440465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.440798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.441380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.441746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.442075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.442398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.442716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.443102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.443513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.443842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.444164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.444498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.444813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.445161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.445492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.445855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.446202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.446525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.446840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.447189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.447629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.448007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.448525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.448991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.449477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.449869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.450199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.450486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.450809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.451128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.451455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.451897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.452222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.452572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.452897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.453238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.453592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.454099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.455224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.455224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.455224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.455806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.456131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.456477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.457327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.457327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.457500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.457806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.458145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.458489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.458919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.459500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.459606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.459868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.460208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.460528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.460843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.461187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.461606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.463291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.463704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.464064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.464387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.464770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.465153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.465476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.465850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.466172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.466492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.466825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.467149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.467465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.467781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.468104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.468425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.468740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.469059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.469606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.469827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.470043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.470359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.470675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.470994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.471308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.471621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.471938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.472251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.472573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.472886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.473205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.473521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.473881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.474197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.475362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.475741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.476082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.476394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.476708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.477039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.477360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.477715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.478044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.478367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.478730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.479059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.480455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.480455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.480455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.480716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.480988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.481308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.481617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.481969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.482306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.482628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.482948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.483319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.483637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.483954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.484287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.484599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.484916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.485235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.485656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.486019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.486511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.486904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.487324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.487719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.488055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.488590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.489190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.489577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.490638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.490845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.491212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.491510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.491839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.492191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.492556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.492877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.493431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.493814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.494336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.494838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.495166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.495503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.495940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.496365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.496702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.497024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.497365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.497750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.498109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.498445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.498762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.499083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.499397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.499718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.500054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.500385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.500688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.501180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.501502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.501828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.502152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.502459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.502769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.503089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.503412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.503721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.504048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.504551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.504676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.504983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.505297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.505653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.505988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.506300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.506629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.507074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.507470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.507820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.508171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.508499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.508826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.509159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.509494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.509863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.510247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.510548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.510913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.511263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.511580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.512082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.512406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.512743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.513063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.513385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.513758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.514113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.514460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.514781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.515105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.515435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.515761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.516080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.516416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.516734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.517059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.517378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.517736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.518074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.518398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.518721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.519056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.519382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.519698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.520031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.520396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.520718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.521191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.521528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.521774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.522093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.522409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.522724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.522970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124404) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:42:53.531344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:42:53.532161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:42:53.532161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:42:53.532513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:42:53.532767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:42:53.533162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.533491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.533846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.534168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.534500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.534811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.535175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.535450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.535786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.537524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.537524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.537524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787296-12-iscsi {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.537524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.538125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.538125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.538466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.538776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.539099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.539405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.539924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.540237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.540544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.540916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.541188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.541714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.541861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.542150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.542691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.542992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.543150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.543455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787296-12-iscsi {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.543773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.544085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.544399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.548122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.549214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.550812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.551156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.551500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.552013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.552013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.552338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.553403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.553567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.553776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.554127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.554363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.554761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.554950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.555268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.555776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.556111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.556263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.556517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.556929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.557243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.557493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.557826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.558171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.558493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.558803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.559121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.559466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.559879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.560064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.560373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.560693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.561030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.561337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.561593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.562105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.562278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.562549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.562856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.563162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.563590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.563759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.564056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.564360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.564667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.564969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.565275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.565579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.565977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.566209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.566521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.566845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.567167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.567469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.567779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.568107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.568436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.568735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.569038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.569343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.569689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.569988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.570292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.570608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.570915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.571220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.571538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.571840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.572224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.572458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.572766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.573074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.573378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.573698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.573996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.574299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.574600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.574906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.575207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.576279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.576279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.576279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.578106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.578620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.579109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:42:53.579699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.580184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.580676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.581143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.582015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.582566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.583167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.584510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.585012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.585503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.586005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.586708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.587279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.587882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.588350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.588835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.589441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.590175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.590646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.591252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.591995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.592467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.593210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.593851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.594704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.595359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.596090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.596614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.597367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.597981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.598461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.598931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.599993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.600682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.601032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.601504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.602015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.602483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.603080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.603547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.604075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.604569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.610960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.612110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.612110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.612110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.615347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.615536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.616020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.616591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.617198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.617798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.618450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.619032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.619564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.620031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.620513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.621041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.621540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.621749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO dbcounter [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Registered counter for database nova_api Jun 24 08:42:53.622150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.622624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.623086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.623632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.624474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.624972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.625889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.626180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.627062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.627858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.628332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.628814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.629287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.629793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.630336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.630973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.631830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.632259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.633144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.633933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.634956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.635605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.636331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.636799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.637364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.638074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.638516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.638996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.639462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.640018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.640573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.641169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.641701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.642163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.642635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.643090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.643761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.644207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.645023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.645543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.646661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.647251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.647824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.648710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.649347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.649915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.650534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.651072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.651601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.652344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.653112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.653620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.654207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.655029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.655631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.656143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.656640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.657211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.657653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.658200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.658791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.659445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.659960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.660472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.660880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_db.sqlalchemy.engines [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:53.661069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.661870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.662618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.663055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.663485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.663990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.664420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.664965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.665403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.665883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.666307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.666735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.667662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.667903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.668417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.668930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.669517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.669758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.670252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.671458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.671458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.671458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.671892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.672231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.672706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.673045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.673555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.674187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.674544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.674930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.675358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.675565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.675911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.676233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.676563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.676893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.677205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.677718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.678302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.678491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.678644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.679854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.679854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.679854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.680393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.680512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writer thread running {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:53.680627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.680796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.680961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.681458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.681613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.684524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.684857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.685199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.685590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.685871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.686197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.686622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.686833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.687176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.687644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.687837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.688646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.688646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.688975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.688975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.689626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.690191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.690453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.692873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.693203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.693533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.693910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.694409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.694727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.695047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.695357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.695791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.695972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.696275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.696582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.696888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.697193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.697501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.697841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.698151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.698474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.699000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.699193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.699478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.699831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.700076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.701011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.701011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.701336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.701488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.705726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.706691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.707662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.708347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.709576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.710247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.710945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.711625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.712321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.713006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.713849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.714568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.715275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.715970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.716666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.717496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.718199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.718884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.719590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.720257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.720950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.721688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.722436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.723114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.723801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.725333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.726135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.726849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.727714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.728427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.729172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.729898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.730579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.731279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.731980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.732642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.733336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.734083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.734801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.735479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.736179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.736880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.737765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.738517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.739224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.739901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.740553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.741257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.742050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.742764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.743551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.744243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.744946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.745633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.746602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.747007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.747775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.748282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.748798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.749318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.749888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.750390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.750887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.751598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.752121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.752809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.753522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.754180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.754715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.755212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.755842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.756355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.756858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.757441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.758056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.758742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.759439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.759958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.760482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.760981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.761596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.762223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.762737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.763231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.763754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.764270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.764765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.765261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.766071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.766433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.766937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.767662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.768229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.768734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.769233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.769866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.770391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.770902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.772156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.772737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.773389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.774023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.774586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.775121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.775384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.context [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c923a23-3d41-45e5-8eb6-16c539602677(cell1) {{(pid=124404) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:42:53.775840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.776490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.776995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.777572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.778138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.778643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.779164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.779969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.780456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.780963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.781148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.782438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.782643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.783181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.783354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.784035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.784221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:53.784705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.785206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.785772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.786410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.786620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:53.787745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.788229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.788893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.789711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.789904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO dbcounter [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Registered counter for database nova_cell0 Jun 24 08:42:53.790560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.791019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.791541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.792063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.792918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.793502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.794049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.794575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.794747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO dbcounter [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Registered counter for database nova_cell1 Jun 24 08:42:53.795230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.795860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.796379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.797152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.798510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.798510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.799312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.799850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.808969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_db.sqlalchemy.engines [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.811851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_db.sqlalchemy.engines [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:53.812025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.812025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.812025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.812993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.813352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.814004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.814466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.815120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.815715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.816289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.816855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.817585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.818154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.819471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.819471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.820005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.820492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.820951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writer thread running {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:53.821152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.821544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.822245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.822743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.823218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.823697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.824173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.824763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.825177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.825699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.826180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writer thread running {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:53.826358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.827016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.827360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.827825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.828289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.829223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.829768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.830155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.830752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.831322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.831806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.832305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.832788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.833293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.834357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.834839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.835359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.835840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.836321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.836798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.837278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.837787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.838376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.838861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.839501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.840356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.841522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.841724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.842220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.842702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.843182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.843663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.844145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.844639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.845101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.845561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.846084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.846553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.847038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.847514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.847978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.848515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.848981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.850573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.850974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.851445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.851900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.852391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.852857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.853323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.853820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.854281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.854722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.855151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.855582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.856012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.856444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.856875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.857312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.857855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.858304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.858811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.859305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.859765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.860629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.861101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.861560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.862033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.862482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.862914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.863339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.863779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.864203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.864618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.865186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.865611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.866054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.866500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.866972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.867491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.868066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.868474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.869193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.869595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.870022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.870408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.870864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.871324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.871688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.872062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.872427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.872784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.873243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.873796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.874177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.874600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.875028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.875448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.875860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.876278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.876701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.877135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.877549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.877997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.878446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.879048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.879373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.879790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.880206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.880811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.881147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.881651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.882129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.882564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.882989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.883410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.883833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.884295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.884843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.885264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.885826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.886180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.886608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.887053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.887473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.887891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.888401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.888839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.889792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.890560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.891061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.891629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.892495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.893142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.893743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.894216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.894781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.895328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.895865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.897035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.897555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.898098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.898569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.900361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.901171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.901626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.902061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.902460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.902929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.903401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.903871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.904362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.904834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.905300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.905812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.906312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.906736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.907166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.907596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.908014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.908442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.908883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.909309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.909770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.910322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.910751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.911185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.911629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.912614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.913059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.913494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.913946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.914390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.914809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.915253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.915730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.916349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.916693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.917108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.917524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.917989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.918410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.918839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.919255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.919764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.920142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.920569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.920978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.921387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.921842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.922257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.922673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.923095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.923602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.924016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.924426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.924911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.925463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.926038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.926564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.926943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.927300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.927686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.928047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.928549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.928911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.929346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.929962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.930630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.931121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.931618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.932058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.932493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.932927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.933352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.933838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.934264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.934697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.935126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.935545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.935961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.936386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.936895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.937332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.937860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.938297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.938732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.939171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.939596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.940045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.940489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.941049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.941475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.941989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.942409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.942829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.943286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.943709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.944250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.944686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.945108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.945541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.946026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.946496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.947059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.947615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.948053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.948474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.948893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.949311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:42:53.949719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124405) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:42:54.018875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO dbcounter [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Registered counter for database nova_cell0 Jun 24 08:42:54.029425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_db.sqlalchemy.engines [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124404) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:54.036252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writer thread running {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:54.117917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO dbcounter [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Registered counter for database nova_api Jun 24 08:42:54.142104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_db.sqlalchemy.engines [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:54.150893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writer thread running {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:54.219230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.context [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c923a23-3d41-45e5-8eb6-16c539602677(cell1) {{(pid=124405) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 08:42:54.224206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.226781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.227861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:42:54.230178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:42:54.232543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO dbcounter [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Registered counter for database nova_cell0 Jun 24 08:42:54.238166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO dbcounter [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Registered counter for database nova_cell1 Jun 24 08:42:54.249174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_db.sqlalchemy.engines [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:54.250706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_db.sqlalchemy.engines [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:54.259202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writer thread running {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:54.261285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writer thread running {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:54.404166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: WARNING keystonemiddleware.auth_token [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:42:54.412810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: WARNING keystonemiddleware.auth_token [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:42:54.468627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO dbcounter [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Registered counter for database nova_cell0 Jun 24 08:42:54.481012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_db.sqlalchemy.engines [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124405) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:42:54.488118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writer thread running {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:42:54.869627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: WARNING keystonemiddleware.auth_token [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:42:54.882540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: WARNING keystonemiddleware.auth_token [None req-5daa47ce-c246-4d92-b299-ae4b5e369f9b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:42:54.889995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fa0a8de9c0 pid: 124404 (default app) Jun 24 08:42:54.934494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: WARNING keystonemiddleware.auth_token [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:42:54.942340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: WARNING keystonemiddleware.auth_token [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:42:55.309949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: WARNING keystonemiddleware.auth_token [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 08:42:55.316666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: WARNING keystonemiddleware.auth_token [None req-6b4f5386-05b0-4e0f-a4c3-de02419609fa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 08:42:55.324813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55fa0a8de9c0 pid: 124405 (default app) Jun 24 08:43:39.899892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.905526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.908346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.911037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.345901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.349157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.351934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.355802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:41.661374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f12ad1f-4193-42a4-9f78-93f26ea98521 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Action: 'create', calling method: .version_select at 0x7fa68d883790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291910296", "metadata": {"Type": "work"}}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f12ad1f-4193-42a4-9f78-93f26ea98521 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 122 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:41.695841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1291910296", "metadata": {"Type": "work"}}} Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:41.697618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1291910296', 'metadata': {'Type': 'work'}}}} Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:41.698450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:43:41.699773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:43:41.700912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 08:43:41.700912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:41.703130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f12ad1f-4193-42a4-9f78-93f26ea98521 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:41.704379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f12ad1f-4193-42a4-9f78-93f26ea98521 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.838758 Jun 24 08:43:41.705505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 24 08:43:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1842 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:43:41.717339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f0e5913d-d58c-41f4-9227-e9522a08fb24 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d79aaf0>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:42.014793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-54660b60-b6e8-4c6b-8d30-eaeb55b63dba tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Action: 'create', calling method: .version_select at 0x7fa68d83c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-61394887", "metadata": {"Type": "work"}}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:43.367985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f0e5913d-d58c-41f4-9227-e9522a08fb24 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/aee8f3e2-ad44-43ff-9ad6-2b85c03e4856" status: 200 len: 351 microversion: 2.1 time: 1.660836 Jun 24 08:43:43.369917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:41 2022] GET /compute/v2.1/os-volumes/aee8f3e2-ad44-43ff-9ad6-2b85c03e4856 => generated 351 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:43.376274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-95dfdb1f-ca5c-49b1-ad65-aaf8a265157a tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Action: 'create', calling method: .version_select at 0x7fa68d705ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-990082339", "metadata": {"Type": "work"}}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-95dfdb1f-ca5c-49b1-ad65-aaf8a265157a tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 119 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:43.390396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-990082339", "metadata": {"Type": "work"}}} Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:43.391756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-990082339', 'metadata': {'Type': 'work'}}}} Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi '0' Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:43.392565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:43:43.393956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:43:43.395052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 08:43:43.395052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.395052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-95dfdb1f-ca5c-49b1-ad65-aaf8a265157a tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:43.401517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-95dfdb1f-ca5c-49b1-ad65-aaf8a265157a tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023302 Jun 24 08:43:43.402434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 24 08:43:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:43:43.427695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-777df833-4a45-473e-9b66-03d439d9345b tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Action: 'create', calling method: .version_select at 0x7fa68d713af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1697082622", "metadata": {"Type": "work"}}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-777df833-4a45-473e-9b66-03d439d9345b tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 119 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:43.441038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1697082622", "metadata": {"Type": "work"}}} Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:43.443174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1697082622', 'metadata': {'Type': 'work'}}}} Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise error Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi '' Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:43.444031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 08:43:43.446331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 08:43:43.448078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 08:43:43.448078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:43.448078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-777df833-4a45-473e-9b66-03d439d9345b tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:43.448078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-777df833-4a45-473e-9b66-03d439d9345b tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.036677 Jun 24 08:43:43.449600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 4/4] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 24 08:43:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 08:43:43.467251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-efc35a59-2201-4b97-8ca2-5e92bcb6878f tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Calling method '.version_select at 0x7fa68d713430>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.183433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-efc35a59-2201-4b97-8ca2-5e92bcb6878f tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] HTTP exception thrown: Volume tempest-invalid-2042237933 could not be found. Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-efc35a59-2201-4b97-8ca2-5e92bcb6878f tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2042237933 HTTP/1.1 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:44.187279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Volume tempest-invalid-2042237933 could not be found. Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': 'tempest-invalid-2042237933'} Jun 24 08:43:44.188565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2042237933 could not be found. (HTTP 404) (Request-ID: req-ea2c595f-8b21-4d55-b8bb-4e4c00562e22) Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.189392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:43:44.190569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2042237933 could not be found. Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:44.195166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2042237933 could not be found. Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2042237933 could not be found. Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-efc35a59-2201-4b97-8ca2-5e92bcb6878f tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 404 to user: Volume tempest-invalid-2042237933 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-efc35a59-2201-4b97-8ca2-5e92bcb6878f tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2042237933" status: 404 len: 99 microversion: 2.1 time: 0.727730 Jun 24 08:43:44.199100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 24 08:43:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2042237933 => generated 99 bytes in 729 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:43:44.201861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56b911fe-804b-4b57-b764-a18f139dfb76 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005911 Jun 24 08:43:44.210638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 24 08:43:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:43:44.229113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-03231fb8-e016-40fa-a354-75da3a6630ed tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017307 Jun 24 08:43:44.229873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1136 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 08:43:44.246385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12aa7604-b113-456f-ba64-aa482cfc6600 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Calling method '.version_select at 0x7fa68d71be50>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.642264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-54660b60-b6e8-4c6b-8d30-eaeb55b63dba tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 4.327897 Jun 24 08:43:44.649602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1/8] 10.222.0.48 () {60 vars in 1155 bytes} [Fri Jun 24 08:43:40 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 4338 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 24 08:43:44.655353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4b34e5db-2c94-4b79-bdf8-8bc8b6012e77 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d7024c0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.752886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-12aa7604-b113-456f-ba64-aa482cfc6600 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] HTTP exception thrown: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12aa7604-b113-456f-ba64-aa482cfc6600 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/os-volumes/12f1bdef-1e17-48c2-81fc-2a5e34088891 HTTP/1.1 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:44.756266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '12f1bdef-1e17-48c2-81fc-2a5e34088891'} Jun 24 08:43:44.757901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. (HTTP 404) (Request-ID: req-c25a524f-3831-45c9-bc39-06c77f5d69df) Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.759645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 08:43:44.760888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 08:43:44.762012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. Jun 24 08:43:44.763135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:44.767413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12aa7604-b113-456f-ba64-aa482cfc6600 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 404 to user: Volume 12f1bdef-1e17-48c2-81fc-2a5e34088891 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:44.768532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12aa7604-b113-456f-ba64-aa482cfc6600 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/12f1bdef-1e17-48c2-81fc-2a5e34088891" status: 404 len: 109 microversion: 2.1 time: 0.532440 Jun 24 08:43:44.769181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 8/9] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 08:43:44 2022] DELETE /compute/v2.1/os-volumes/12f1bdef-1e17-48c2-81fc-2a5e34088891 => generated 109 bytes in 534 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:44.803966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44ba5b5e-4441-4dac-ad12-63452148de46 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Calling method '.version_select at 0x7fa68d71bee0>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:44.966385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4b34e5db-2c94-4b79-bdf8-8bc8b6012e77 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 200 len: 351 microversion: 2.1 time: 0.284818 Jun 24 08:43:44.966385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 2/10] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 351 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:45.360196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-44ba5b5e-4441-4dac-ad12-63452148de46 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] HTTP exception thrown: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44ba5b5e-4441-4dac-ad12-63452148de46 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Request method failure captured: Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/os-volumes/0ad71dec-b38b-4cea-b3df-c8d5f33a3062 HTTP/1.1 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXk7jcZyaKfttoF4BnvHwi5W2ClrvTnpGHEKh5OD8ksA8DFl3kY4sNYCSZXBpdEpm8e0z44z8w3lON_CxGxzuJ5XSLvXA0oikCyfvjlHZ4_AA1wY8Oml8i3fcs2n1vvNUaZjJkh4Pr_G4WhHz8GPgkWuEiz2_Cq2jYpwEKfZtP1jK1A Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:43:45.369940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a96291bf2064782ae193ec7d3ae2f33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 5a96291bf2064782ae193ec7d3ae2f33 Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesNegativeTest-914497983 Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: d1e0edfb2b8e48f994f7fcdc48936a16 Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesNegativeTest-914497983-project Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '0ad71dec-b38b-4cea-b3df-c8d5f33a3062'} Jun 24 08:43:45.371193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. (HTTP 404) (Request-ID: req-238632f0-fda7-4d6a-8268-ef47bd05166e) Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:45.371906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:43:45.372872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:43:45.374981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:43:45.376860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44ba5b5e-4441-4dac-ad12-63452148de46 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] Returning 404 to user: Volume 0ad71dec-b38b-4cea-b3df-c8d5f33a3062 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:45.379047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-44ba5b5e-4441-4dac-ad12-63452148de46 tempest-VolumesNegativeTest-914497983 tempest-VolumesNegativeTest-914497983-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0ad71dec-b38b-4cea-b3df-c8d5f33a3062" status: 404 len: 109 microversion: 2.1 time: 0.600959 Jun 24 08:43:45.379047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 9/11] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:44 2022] GET /compute/v2.1/os-volumes/0ad71dec-b38b-4cea-b3df-c8d5f33a3062 => generated 109 bytes in 604 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:43:45.857964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b6301c63-f2ae-4d92-ba21-ac54db8b3c99 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d702820>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.950832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-04c236ff-f841-4f03-bd0e-c7e3d196df37 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d79a790>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:45.994613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b6301c63-f2ae-4d92-ba21-ac54db8b3c99 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/041e9634-ecf6-4cc6-bb27-9d32be306c44" status: 200 len: 351 microversion: 2.1 time: 0.140555 Jun 24 08:43:46.002305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 3/12] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/os-volumes/041e9634-ecf6-4cc6-bb27-9d32be306c44 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:46.156905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-04c236ff-f841-4f03-bd0e-c7e3d196df37 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 200 len: 352 microversion: 2.1 time: 0.210895 Jun 24 08:43:46.157529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 10/13] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:45 2022] GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 352 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:46.169891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-00a6d7ab-bf8c-4d05-bfea-a2b539fc4ad9 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d702d30>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.393011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-00a6d7ab-bf8c-4d05-bfea-a2b539fc4ad9 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 200 len: 352 microversion: 2.1 time: 0.227844 Jun 24 08:43:46.393708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 4/14] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:46.411926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a16e78d0-8d89-42a2-a799-6a129ffdad5d tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d71b1f0>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:46.849729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a16e78d0-8d89-42a2-a799-6a129ffdad5d tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 202 len: 0 microversion: 2.1 time: 0.442145 Jun 24 08:43:46.850603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 11/15] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 08:43:46 2022] DELETE /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:43:46.870594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-22f7ca15-c1d0-40e2-b890-912174c9bf18 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d71a430>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:47.333057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-22f7ca15-c1d0-40e2-b890-912174c9bf18 tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 200 len: 351 microversion: 2.1 time: 0.475997 Jun 24 08:43:47.333651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 5/16] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:46 2022] GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 351 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:48.099815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1611053413", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "networks": [{"uuid": "4e1f06da-f9ef-4f77-8255-07ac1aeaff94"}]}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:43:48.352310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45e17728-2052-405b-8020-25d2b87afcef tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Calling method '.version_select at 0x7fa68d702d30>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:48.397944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] validate_networks() for [('4e1f06da-f9ef-4f77-8255-07ac1aeaff94', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:43:48.517525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-45e17728-2052-405b-8020-25d2b87afcef tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] HTTP exception thrown: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45e17728-2052-405b-8020-25d2b87afcef tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Request method failure captured: Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 HTTP/1.1 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXk8wmGZ45XFsYSC4B6USFAWlGEp4jyvcg_hUncSDCQoUfgSsYnaa3xt-g-JD4jqu_pUwQkTIrOit44lgl-olUi1kpCh1PmE0oJp4VJN5_afD_KXFX-6JGxveSD1J_jZl_pwPC3nW50XnyEFzkBR_X4f_TFWgHS-GHEfhjXJ3Ez1c_o Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 76264820d0654a94960ae33332f96378 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesGetTestJSON-1116719654 Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:43:48.533810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76264820d0654a94960ae33332f96378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76264820d0654a94960ae33332f96378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76264820d0654a94960ae33332f96378"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76264820d0654a94960ae33332f96378"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesGetTestJSON-1116719654 Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 76264820d0654a94960ae33332f96378 Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesGetTestJSON-1116719654 Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesGetTestJSON-1116719654-project Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 30185465fa184e37921a4b4bfda2de59 Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesGetTestJSON-1116719654-project Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'c9f4d495-8454-4ca2-bea7-8fe9382d4975'} Jun 24 08:43:48.535895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. (HTTP 404) (Request-ID: req-847c873c-be7a-43a4-8180-b713cb6d9204) Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:48.537234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 08:43:48.541582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 08:43:48.544694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45e17728-2052-405b-8020-25d2b87afcef tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] Returning 404 to user: Volume c9f4d495-8454-4ca2-bea7-8fe9382d4975 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-45e17728-2052-405b-8020-25d2b87afcef tempest-VolumesGetTestJSON-1116719654 tempest-VolumesGetTestJSON-1116719654-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975" status: 404 len: 109 microversion: 2.1 time: 0.195793 Jun 24 08:43:48.550206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 6/17] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/os-volumes/c9f4d495-8454-4ca2-bea7-8fe9382d4975 => generated 109 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:43:48.601190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1bca2b6b-eeab-413b-94af-d08855c11681 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68e0df8b0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:48.701704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1bca2b6b-eeab-413b-94af-d08855c11681 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/94520d24-186c-4009-8a13-05b9d952bf26" status: 200 len: 351 microversion: 2.1 time: 0.107423 Jun 24 08:43:48.703490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 7/18] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/os-volumes/94520d24-186c-4009-8a13-05b9d952bf26 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:48.730647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fae629c3-7e48-42d0-af03-9db8619faed9 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d702e50>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.054147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fae629c3-7e48-42d0-af03-9db8619faed9 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.334055 Jun 24 08:43:49.055410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 8/19] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 24 08:43:48 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:49.086686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aad2da33-8f70-41d1-8d3a-451f3ae3f0da tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d681b80>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.525022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aad2da33-8f70-41d1-8d3a-451f3ae3f0da tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.450103 Jun 24 08:43:49.525629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 9/20] 10.222.0.48 () {58 vars in 1148 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:49.545282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98f45fba-1a4d-4712-a49c-7bfa33c009be tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d680820>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.822209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98f45fba-1a4d-4712-a49c-7bfa33c009be tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.279750 Jun 24 08:43:49.829214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 10/21] 10.222.0.48 () {58 vars in 1133 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:49.835225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5348533-c52b-4351-9d0a-f192716f68f5 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d680c10>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:49.994129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5348533-c52b-4351-9d0a-f192716f68f5 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.162543 Jun 24 08:43:49.995214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 11/22] 10.222.0.48 () {58 vars in 1166 bytes} [Fri Jun 24 08:43:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:50.009978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-751eb206-cba6-4b5c-8cef-cead161e236f tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d702c10>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.218999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-751eb206-cba6-4b5c-8cef-cead161e236f tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.215329 Jun 24 08:43:50.219692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1169 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:43:50.237379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24090ee1-2dc4-4b6a-8f45-1f3121a4f559 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d6821f0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.437212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24090ee1-2dc4-4b6a-8f45-1f3121a4f559 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.207650 Jun 24 08:43:50.439010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:43:50.456764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5b6f4e95-aed2-430f-8924-5d5d24e69521 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d702ee0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.676085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5b6f4e95-aed2-430f-8924-5d5d24e69521 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.225401 Jun 24 08:43:50.677420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1187 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:43:50.691918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26eb2078-4a9d-426d-aed7-e0bb5e212b53 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] Calling method '.version_select at 0x7fa68d680310>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:50.832198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:43:50.833022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:43:50.833188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:43:50.833478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:43:50.834085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:43:50.868407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.870159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.871362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:50.872063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:50.891233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-26eb2078-4a9d-426d-aed7-e0bb5e212b53 tempest-VolumesTestJSON-1996082629 tempest-VolumesTestJSON-1996082629-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.203052 Jun 24 08:43:50.891867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 15/26] 10.222.0.48 () {58 vars in 1154 bytes} [Fri Jun 24 08:43:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:50.958484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Getting quotas for project 9e9f6b1d49d54cc2aaa226ae399588b3. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:43:50.970400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Getting quotas for user 8960954266f24a5985d140f5fd0453dd and project 9e9f6b1d49d54cc2aaa226ae399588b3. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:43:50.994113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:43:51.000344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:43:51.184150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9ba81468-5484-4952-84f9-a3cf59389443 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.589756 Jun 24 08:43:51.186319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 12/27] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:43:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:43:51.197410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-35638b0f-b47a-4e83-b5ff-ec50ccd57a7f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:51.198276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-35638b0f-b47a-4e83-b5ff-ec50ccd57a7f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:51.541165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-35638b0f-b47a-4e83-b5ff-ec50ccd57a7f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:51.573778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-35638b0f-b47a-4e83-b5ff-ec50ccd57a7f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1215 microversion: 2.1 time: 0.378848 Jun 24 08:43:51.586148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 16/28] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:51 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:52.594283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9a7633ad-15ab-4bef-8e85-214c1e8c7271 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:52.594957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9a7633ad-15ab-4bef-8e85-214c1e8c7271 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:53.038259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9a7633ad-15ab-4bef-8e85-214c1e8c7271 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:53.114982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9a7633ad-15ab-4bef-8e85-214c1e8c7271 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1215 microversion: 2.1 time: 0.518450 Jun 24 08:43:53.129552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 13/29] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:52 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1215 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:54.150940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:54.152102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:54.185213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.186198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.187754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:54.188550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:54.596386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:54.620487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-83f45ccc-f2a6-4f47-9817-0b23115039c4 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1211 microversion: 2.1 time: 0.486762 Jun 24 08:43:54.621116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 17/30] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:54 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1211 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:55.639746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:55.641175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:55.659467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.660159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:55.662435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:55.668679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:56.393109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:56.420390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f63d48bf-1d8e-42dc-9ebc-3e8e643234ab tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1275 microversion: 2.1 time: 0.785845 Jun 24 08:43:56.421002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 14/31] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:55 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1275 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:57.449335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:57.454053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:57.466377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.467294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:57.468323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:57.469396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:58.461579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:43:58.514656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c60cf7a6-453b-48a6-82f6-f30c92417d2a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1273 microversion: 2.1 time: 1.080071 Jun 24 08:43:58.538846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 18/32] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:57 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1273 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:43:59.552461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:43:59.553790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:43:59.565849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.566309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:43:59.567095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:43:59.567532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:00.233273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:00.255124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-11415619-67f6-4297-b906-d608cda0dd00 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.706501 Jun 24 08:44:00.291969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:43:59 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:01.315803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:01.316941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:01.344415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:01.352550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.355186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.361739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:01.362896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:01.570072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:02.033902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1190234250", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:02.235277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:02.290134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef7a6ac4-36e5-44c5-9dd0-bc2a5ef5f829 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.977161 Jun 24 08:44:02.291927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:01 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:02.361066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] validate_networks() for [('1dee5e65-a25a-406c-88bc-d2e389f155d0', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:44:03.088380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=8 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:03.447353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-93cbf6d9-c577-4f3d-806e-658bc5db3b0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: .version_select at 0x7fa68c466550>, body: {"keypair": {"name": "tempest-keypair-184538959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKih9NcscN8pRmYuAcqcdqjoJcWLYspXcFKb1GkWLosF8NQTkzD0Hy/XUVFpQ4bWcvPKOFXbTp6vtBatyNvZtqBlhB8e531+ePmEL1qhJWs5adICsiDpbDbbRzx8+DjyZg=="}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:03.566922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-93cbf6d9-c577-4f3d-806e-658bc5db3b0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for project 1228688aff08407bb65f0876f4de6249. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:03.579167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-93cbf6d9-c577-4f3d-806e-658bc5db3b0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for user 0a3be1ca51b0472eb1a23f9d052a3c75 and project 1228688aff08407bb65f0876f4de6249. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:03.746487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-93cbf6d9-c577-4f3d-806e-658bc5db3b0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.452155 Jun 24 08:44:03.761398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 17/35] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 24 08:44:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1459 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 08:44:03.809112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:03.813948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:03.892571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.894964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:03.900308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:03.903682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:06.838939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:06.850215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60c9a667-9ad4-428c-84fb-eb6f07da2775 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 3.081799 Jun 24 08:44:06.852094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:03 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 3087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:07.568842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:44:07.569608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:44:07.570971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:44:07.571717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:44:07.572477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:44:07.638168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.639064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.640759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.644109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.774543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:07.803137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for user 7152500089314edea337b9a58830f12d and project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:07.855786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:44:07.869093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:44:07.871793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:07.872983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:07.895778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.896316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:07.897194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:07.897676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:08.091496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8306f54b-0fb3-4ebb-9d6c-0595be8a8f57 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.725855 Jun 24 08:44:08.092160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:44:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 7728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:44:08.104121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a608fb3-c8ae-4b1c-854c-896bb58265cc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:08.105018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2a608fb3-c8ae-4b1c-854c-896bb58265cc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:09.077803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2a608fb3-c8ae-4b1c-854c-896bb58265cc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.086171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2a608fb3-c8ae-4b1c-854c-896bb58265cc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1222 microversion: 2.1 time: 0.986704 Jun 24 08:44:09.086779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 20/38] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:08 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1222 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:09.408116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:09.422513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-57210291-2315-4248-a1d7-3ab1640b3354 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 1.555566 Jun 24 08:44:09.425563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 19/39] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:07 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:09.616178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1193360082", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:09.858254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] validate_networks() for [('1dee5e65-a25a-406c-88bc-d2e389f155d0', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:44:10.789579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-88fb0917-116f-4f45-b385-d0da6bca2fa1 req-60ec5d66-d68f-4011-b237-f6eb830183c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3", "tag": "ad1355b1-e2a1-42e2-9c82-29bff6e31e45"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:10.793973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:10.843406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-88fb0917-116f-4f45-b385-d0da6bca2fa1 req-60ec5d66-d68f-4011-b237-f6eb830183c8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.844052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-88fb0917-116f-4f45-b385-d0da6bca2fa1 req-60ec5d66-d68f-4011-b237-f6eb830183c8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.951486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-88fb0917-116f-4f45-b385-d0da6bca2fa1 req-60ec5d66-d68f-4011-b237-f6eb830183c8 service nova] Creating event network-changed:ad1355b1-e2a1-42e2-9c82-29bff6e31e45 for instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 on hv-cinder-78729 Jun 24 08:44:10.955449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-88fb0917-116f-4f45-b385-d0da6bca2fa1 req-60ec5d66-d68f-4011-b237-f6eb830183c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124404) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:44:10.961142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.964352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:10.987347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:10.989739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.074103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.compute.rpcapi [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:44:11.076144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] Releasing lock "compute-rpcapi-router" {{(pid=124404) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:44:11.161457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e991edf5-7c86-4e23-900b-9fc0336af772 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.067056 Jun 24 08:44:11.175896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 20/40] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:11.232928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:11.244900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:11.260168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.261788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:11.264067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:11.265038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:13.178247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:13.199183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f8b8ea63-255e-425f-b270-5d9413e19351 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 2.013443 Jun 24 08:44:13.221602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:11 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:13.627585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1459226869", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59b4a86f-643d-49ec-adbf-4386438b074f"}], "security_groups": [{"name": "tempest-securitygroup--769391064"}], "key_name": "tempest-keypair-184538959", "user_data": "}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:13.661475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:14.150154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:44:14.150660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:44:14.150814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:44:14.151266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:44:14.151699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:44:14.171251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.171991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.175325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.176172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.244562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:14.266098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for user 7152500089314edea337b9a58830f12d and project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:14.303880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] validate_networks() for [('59b4a86f-643d-49ec-adbf-4386438b074f', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:44:14.313026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:44:14.315314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:44:14.484776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c0ec5228-eeae-44ea-b038-891d42f1f11d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.873070 Jun 24 08:44:14.490642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:44:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 4879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:44:14.504115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:14.504754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:14.547502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.548933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:14.551581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:14.567109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.048929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.064694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a74d277f-95a8-48e0-807c-db1520c0b25b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.572811 Jun 24 08:44:15.068200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 22/43] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:14 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:15.080550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0792824-691c-4b8a-98e4-0a2da5174113 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.083526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0792824-691c-4b8a-98e4-0a2da5174113 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:15.295232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0792824-691c-4b8a-98e4-0a2da5174113 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:15.318043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0792824-691c-4b8a-98e4-0a2da5174113 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1222 microversion: 2.1 time: 0.246156 Jun 24 08:44:15.333520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:15.733599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:44:15.735318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:44:15.736639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:44:15.737446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:44:15.738494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:44:15.765455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.767819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.769089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:15.769734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:15.800431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for project 1228688aff08407bb65f0876f4de6249. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:44:15.810737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for user 0a3be1ca51b0472eb1a23f9d052a3c75 and project 1228688aff08407bb65f0876f4de6249. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:44:15.834339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:44:15.840327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:44:15.944412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f873c41a-1435-497e-8f0f-445daa0bb43b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.326583 Jun 24 08:44:15.947320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 22/45] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 24 08:44:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 08:44:15.958440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:15.959572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.092562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:16.093246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.105204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.116012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.116893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.119144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.124807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.125949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.129351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.131130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a764ffe2-84a6-4806-b1c6-e4ccd46287e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1281 microversion: 2.20 time: 0.178141 Jun 24 08:44:16.147289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:16.341144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:16.341968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:16.360791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.362400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.364283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:16.369022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:16.464786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.481714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d388e34b-778d-4f72-8fd2-04e12657da65 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.390995 Jun 24 08:44:16.492154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 23/47] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:16.511469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:16.528471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b7dd1891-4623-47f0-ac74-d6ec6a765ca0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1226 microversion: 2.1 time: 0.190381 Jun 24 08:44:16.529653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:16 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:17.166293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.170155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.186918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.188387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.190129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.191161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.311318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.325282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.328388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.329853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9a881733-5be0-4f1d-871a-c9162b1d14fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1285 microversion: 2.20 time: 0.174647 Jun 24 08:44:17.330758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:17.512006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.513025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.525323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.526957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.528825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.530051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.550850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:17.552046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:17.569782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.570190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.571425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:17.572052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:17.730996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.752727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6e963505-2c2d-4f5d-b9c2-986e576822dc tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1226 microversion: 2.1 time: 0.206985 Jun 24 08:44:17.756326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1226 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:17.813570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:17.827046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-be08984e-5902-480b-8911-4cbcfd6c1f21 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.324857 Jun 24 08:44:17.827848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 26/51] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:17 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:18.359504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.360523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.383654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.384481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.386543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.387557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.490260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.505546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.508696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.510860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bf045e98-8f4b-46af-8598-277dad44f593 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1285 microversion: 2.20 time: 0.158261 Jun 24 08:44:18.512453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:18.774715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.775346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.783137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.783849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.784743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.785310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.857733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:18.858562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:18.861273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:18.866423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.866988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.867916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:18.868543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:18.881282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-62ee4371-a761-43a6-b2c7-7921e6829700 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1226 microversion: 2.1 time: 0.111513 Jun 24 08:44:18.883621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 27/53] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1226 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:19.035465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:19.052537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d14c7d0b-9505-49e9-8cb8-6b2ca86735cf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.200798 Jun 24 08:44:19.053632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 27/54] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:18 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:19.556214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.558811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.610464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.613646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.621890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:19.629906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:19.950511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:19.953461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:19.991360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.010131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.010708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.011771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.027319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.078193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.083771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=75 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:20.085632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:20.094383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7ae2b79-5923-4fec-9202-5557752d1ceb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1285 microversion: 2.20 time: 0.559121 Jun 24 08:44:20.123656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 28/55] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1285 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:20.158060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:20.163352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:20.208527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.215492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:20.218286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:20.223300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.246738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.264036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f3ddce7c-da08-4ba5-bef6-35dd155304d6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 1.338574 Jun 24 08:44:21.264884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 28/56] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:19 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:21.271974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:21.278277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:21.300662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.301981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.303294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:21.304178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:21.525577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.561435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.585713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.591127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d6fbc27-235e-4c6a-880a-d227842538e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.321755 Jun 24 08:44:21.594719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 29/57] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:21.640703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:21.649561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=51 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:21.673167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6ae5b09e-8d57-4ba0-9a7c-99b5104c7617 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 1.546131 Jun 24 08:44:21.676765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 29/58] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:20 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:22.175297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-65e10f90-8d6b-48b2-b248-d75c5f2db1ee req-cc2af237-137a-4d9f-b279-6bd988b1a87c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8717b2ef-e244-4d90-a381-3afddfc2833e", "tag": "3c6e2dd8-a912-4487-9065-1cf694fd04c2"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:22.186207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-65e10f90-8d6b-48b2-b248-d75c5f2db1ee req-cc2af237-137a-4d9f-b279-6bd988b1a87c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.186853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-65e10f90-8d6b-48b2-b248-d75c5f2db1ee req-cc2af237-137a-4d9f-b279-6bd988b1a87c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.200322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-65e10f90-8d6b-48b2-b248-d75c5f2db1ee req-cc2af237-137a-4d9f-b279-6bd988b1a87c service nova] Creating event network-changed:3c6e2dd8-a912-4487-9065-1cf694fd04c2 for instance 8717b2ef-e244-4d90-a381-3afddfc2833e on hv-cinder-78729 Jun 24 08:44:22.207072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-65e10f90-8d6b-48b2-b248-d75c5f2db1ee req-cc2af237-137a-4d9f-b279-6bd988b1a87c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213757 Jun 24 08:44:22.208343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 30/59] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:22.299928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.301414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.304933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:22.317912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.318648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.319932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.321026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.455250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.475351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-73c83de3-fe62-49cb-b694-c14a70fd00ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.184780 Jun 24 08:44:22.476944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 30/60] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:22.615146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.616538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.624933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.625607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.626561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.626989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.697344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:22.698849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:22.709923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.710760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.711967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:22.712562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:22.721512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.733468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.735119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.736278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56080d4a-b64c-4e93-9aa6-6faac3d00348 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.125589 Jun 24 08:44:22.742973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:22.954880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:22.965201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-218b9fff-5917-4e66-aa36-771ab80ba615 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.272759 Jun 24 08:44:22.965774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 31/62] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:22 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:23.504877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.505495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.512375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.512864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.513633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.514108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.639188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.651839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40bf44cc-8210-42d6-b5a5-f9d038b57dbe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.153179 Jun 24 08:44:23.652436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:23.762728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.763530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.769901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.770614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.771399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.772023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.868930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.889114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.898018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:23.900986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a540e5fd-0efd-4f32-89b8-eb2a999275c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.143077 Jun 24 08:44:23.902334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:23.985906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:23.986588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:23.994128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.994638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:23.995533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:23.996168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.214293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:24.242565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86458cf1-ae70-4893-a2fa-c0f11cef7e07 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.261136 Jun 24 08:44:24.251995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:23 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:24.668498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:24.669136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:24.674808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:24.676468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.677098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.678096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.678682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.760743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:24.772642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e5ee21d-98a4-4274-b5b4-418dcfceabdd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.107883 Jun 24 08:44:24.774843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:24 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:24.932414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:24.934129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:24.944825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.945486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:24.946809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:24.947535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.069867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.087615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.089831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.091069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-afc37c04-83c0-4fc6-8c17-fea782061e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.165575 Jun 24 08:44:25.098241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:25.262835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:25.264170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:25.280051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.291760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.293253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.294274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.619417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.629172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-daf5faef-2f97-40f1-838f-2cdca465c35c tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.372146 Jun 24 08:44:25.629984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:25 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:25.795597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:25.802905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:25.804020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:25.827807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:25.832738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.833437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.834588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:25.835128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:25.934506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:25.947268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b8045bc-1f4e-4318-b286-9a571f8e416f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.159336 Jun 24 08:44:25.948271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:25 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:26.112123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:26.112700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:26.123236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=18 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:26.128268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.129765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.131762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.132474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.217832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:26.227669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:26.229308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:26.230578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-08dc2fdd-a191-4b15-8dc7-bef220a4ae89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.123920 Jun 24 08:44:26.231240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 35/70] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:26.660162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:26.661396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:26.673474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.674460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.675978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.677039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.912847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:26.924995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07ab3b97-a534-41a9-bf9a-193ce33f288e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.273392 Jun 24 08:44:26.925858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:26 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:26.976708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:26.978015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:26.986356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.986960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:26.988077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:26.988707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:27.063916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:27.072617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4d26fd93-0461-495e-90af-499ffd9566b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.103744 Jun 24 08:44:27.073502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 36/72] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:26 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:27.255319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:27.256282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:27.266925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:27.267565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:27.268993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:27.269756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:27.351179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:27.365025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:27.366896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:27.368412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b77c962b-d23a-4363-a2d0-f2b1a52bebf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.119604 Jun 24 08:44:27.369465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 37/73] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:27.957518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:27.958914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:27.971307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:27.971846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:27.973051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:27.974234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.099962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:28.101637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:28.113994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.114858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.116512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.117373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.230483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:28.243435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cfe56550-f690-4143-8ee5-643414f7c2a0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1274 microversion: 2.1 time: 0.151066 Jun 24 08:44:28.244024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 38/74] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:28 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:28.266892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:28.281007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24380ef6-dc03-4ce9-94aa-88251432cb93 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.332291 Jun 24 08:44:28.282073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 37/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:27 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:28.398741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:28.399603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:28.411579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.411579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.412925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:28.413475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:28.515682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:28.553937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:28.560567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:28.563231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f52fcb6c-0236-43c1-968c-c64a45f516ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1333 microversion: 2.20 time: 0.177631 Jun 24 08:44:28.565284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1333 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:29.277116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:29.277948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:29.295082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.299667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.303501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.304197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.310239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:29.311298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:29.326086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.329610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.334019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.335207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.607305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:29.618570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-568db025-6f34-47c3-9fce-c661d8914fcd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1280 microversion: 2.1 time: 0.347037 Jun 24 08:44:29.629694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:29 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1280 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:29.630489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:29.631114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:29.646259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.649903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.651220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:29.653485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:29.883698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:29.920890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:29.942915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:29.951790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e99f2ca5-af30-4c2c-bf01-2f36dec3ecf8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1339 microversion: 2.20 time: 0.330240 Jun 24 08:44:29.957789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 39/78] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:30.010522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:30.024196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33f0fece-43a1-4e57-b89a-fe6690035c0e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.716937 Jun 24 08:44:30.044803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 40/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:29 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:30.661869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:30.669421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:30.695077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:30.696562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:30.700199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:30.702060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:30.879060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:30.895294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-23b6bc08-ee8f-425d-8b16-1e7215dea13d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1280 microversion: 2.1 time: 0.250857 Jun 24 08:44:30.897155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 40/80] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:30 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1280 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:30.991539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:30.992183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:31.002942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.005318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.006195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.006861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.045163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:31.046691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:31.065021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.065898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.066946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.067598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.769814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:31.821795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:31.836394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:31.838599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-65741b58-aae8-4e2f-8014-305560ce6758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.850858 Jun 24 08:44:31.842401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 41/81] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:31.926185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:31.929420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:31.956111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:31.961470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.963419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.966201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:31.973065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:31.987500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ff290b01-476c-4980-bbdc-ab05b301d2f2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.948111 Jun 24 08:44:31.991966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 41/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:31 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:32.462380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:32.475742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71d99fa6-55a6-46e5-8def-e5d4638b476b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.564550 Jun 24 08:44:32.476636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 42/83] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:31 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:32.867683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:32.868745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:32.877077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:32.878143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:32.879388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:32.880139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.009574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:33.010267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:33.035742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.036203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.038809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.042771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.230844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.263709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.283154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.285280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-63f79d17-19d4-45a9-adbf-cabe8905d17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.422287 Jun 24 08:44:33.286176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 42/84] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:33.603230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.615304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bc0e70db-a984-4264-80d0-cd7d3d887ea1 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.606143 Jun 24 08:44:33.627910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:33 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:33.639440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:33.640480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:33.653921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.654387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.655201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.655655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.658778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-e3198cf3-942d-4e9f-9e39-b977ced8efb0 req-4c2cebfe-1c87-4a90-9a2f-9255add1d155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3", "name": "network-vif-plugged", "status": "completed", "tag": "ad1355b1-e2a1-42e2-9c82-29bff6e31e45"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:33.710039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-e3198cf3-942d-4e9f-9e39-b977ced8efb0 req-4c2cebfe-1c87-4a90-9a2f-9255add1d155 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.715304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-e3198cf3-942d-4e9f-9e39-b977ced8efb0 req-4c2cebfe-1c87-4a90-9a2f-9255add1d155 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.761422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-e3198cf3-942d-4e9f-9e39-b977ced8efb0 req-4c2cebfe-1c87-4a90-9a2f-9255add1d155 service nova] Creating event network-vif-plugged:ad1355b1-e2a1-42e2-9c82-29bff6e31e45 for instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 on hv-cinder-78729 Jun 24 08:44:33.762793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-e3198cf3-942d-4e9f-9e39-b977ced8efb0 req-4c2cebfe-1c87-4a90-9a2f-9255add1d155 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 08:44:33.765451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.767788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.769904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:33.771858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:33.792120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.compute.rpcapi [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 08:44:33.795031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] Releasing lock "compute-rpcapi-router" {{(pid=124405) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 08:44:33.825842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b6993c22-dade-4301-b516-63541de2bbb0 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.476776 Jun 24 08:44:33.826629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 43/86] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:33.931857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:33.948902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7864aaf9-5e67-4341-8fd3-2bfd7b7bb885 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.319555 Jun 24 08:44:33.954423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:33 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:34.310229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:34.312514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:34.346106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.347646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.356736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.357196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.639082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:34.640156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:34.671428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.677869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.682065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:34.683415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:34.710873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:34.757061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:34.771569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:34.779546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7c96787e-dbbc-400b-b1d9-c6e0506e6efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.477308 Jun 24 08:44:34.782929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 44/88] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:34.799336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:34.988772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:34.990459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:35.022501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.023235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.032304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.033529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.318383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:35.342158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-78a9e76c-7067-43c8-9a0e-ae7b0a6dd21e tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.711429 Jun 24 08:44:35.346889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:34 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:35.801971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:35.804152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:35.832713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.833538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:35.842111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:35.843423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:36.440843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:36.456703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-55f05b6f-b743-4c90-962d-f01b852be3d2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 1.482647 Jun 24 08:44:36.460854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 45/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:34 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:36.476614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:36.480099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:36.499004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:36.499565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:36.500449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:36.501122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.359418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:37.400062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:37.406658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:37.412514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-213e73dc-c306-4cad-87e4-d51b9e33da3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 1.614342 Jun 24 08:44:37.451918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 46/91] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:37.486312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-efe65c5b-8875-4504-967e-e9dfef335192 req-317e7f61-7c19-4984-a47f-0e58fa1e8d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fc2b80-e02c-4179-b740-707cd0b41089", "tag": "b75490f8-63fa-4519-9fcb-164db7181bf0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:37.504374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-efe65c5b-8875-4504-967e-e9dfef335192 req-317e7f61-7c19-4984-a47f-0e58fa1e8d3e service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.504877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-efe65c5b-8875-4504-967e-e9dfef335192 req-317e7f61-7c19-4984-a47f-0e58fa1e8d3e service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.537567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-efe65c5b-8875-4504-967e-e9dfef335192 req-317e7f61-7c19-4984-a47f-0e58fa1e8d3e service nova] Creating event network-changed:b75490f8-63fa-4519-9fcb-164db7181bf0 for instance 19fc2b80-e02c-4179-b740-707cd0b41089 on hv-cinder-78729 Jun 24 08:44:37.550362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-efe65c5b-8875-4504-967e-e9dfef335192 req-317e7f61-7c19-4984-a47f-0e58fa1e8d3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093264 Jun 24 08:44:37.556768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 47/92] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:37.568537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-0a5d7025-16eb-400f-accd-7e0e7b30f47a req-2ba74106-5d92-4828-8fa7-6b5990a0303f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8717b2ef-e244-4d90-a381-3afddfc2833e", "name": "network-vif-plugged", "status": "completed", "tag": "3c6e2dd8-a912-4487-9065-1cf694fd04c2"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:37.593495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-0a5d7025-16eb-400f-accd-7e0e7b30f47a req-2ba74106-5d92-4828-8fa7-6b5990a0303f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.596728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-0a5d7025-16eb-400f-accd-7e0e7b30f47a req-2ba74106-5d92-4828-8fa7-6b5990a0303f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.620129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-0a5d7025-16eb-400f-accd-7e0e7b30f47a req-2ba74106-5d92-4828-8fa7-6b5990a0303f service nova] Creating event network-vif-plugged:3c6e2dd8-a912-4487-9065-1cf694fd04c2 for instance 8717b2ef-e244-4d90-a381-3afddfc2833e on hv-cinder-78729 Jun 24 08:44:37.627011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-0a5d7025-16eb-400f-accd-7e0e7b30f47a req-2ba74106-5d92-4828-8fa7-6b5990a0303f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068205 Jun 24 08:44:37.628688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 48/93] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:37.637934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:37.639111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:37.651401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.653282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.654518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:37.655501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:37.850254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:37.854220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:37.894960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bdad6800-257d-49c8-b2c0-60ada2d50801 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 1.421972 Jun 24 08:44:37.904767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 46/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:36 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:38.034480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-48bb0b65-d77b-4319-ab5d-081a320634e8 req-821f3c03-79dd-4bec-a4f5-8158a53d1c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:38.100933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-48bb0b65-d77b-4319-ab5d-081a320634e8 req-821f3c03-79dd-4bec-a4f5-8158a53d1c25 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.101321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-48bb0b65-d77b-4319-ab5d-081a320634e8 req-821f3c03-79dd-4bec-a4f5-8158a53d1c25 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.180641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-48bb0b65-d77b-4319-ab5d-081a320634e8 req-821f3c03-79dd-4bec-a4f5-8158a53d1c25 service nova] Creating event network-changed:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:44:38.210900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-48bb0b65-d77b-4319-ab5d-081a320634e8 req-821f3c03-79dd-4bec-a4f5-8158a53d1c25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189551 Jun 24 08:44:38.216562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 47/95] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:38.432785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.455919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:38.457357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:38.500865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-061fa661-642e-4ebf-8ba6-6d01c070ceb1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.870341 Jun 24 08:44:38.508378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 49/96] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:37 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:38.517524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.518563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.520811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.522947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.755368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.774959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.777457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:38.779119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0294ff39-81fd-4b68-9260-ca8d8305f2b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.337318 Jun 24 08:44:38.780382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 48/97] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:38.931998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:38.932783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:38.949566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.950322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:38.951032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:38.951562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.418370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:39.433464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5d411166-3784-40ba-96e9-951d3263dae7 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1315 microversion: 2.1 time: 0.506263 Jun 24 08:44:39.436631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 50/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:38 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:39.533122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:39.533887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:39.548875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.553982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.554923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.555383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.787348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:39.814336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:39.816036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:39.826444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2af8476e-d797-413c-a528-605ebc646227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.306014 Jun 24 08:44:39.847505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:39 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:39.857813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.866880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:39.868395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:39.868971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.176967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:40.192496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:40.196440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:40.198864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b1ec99f-e51c-417d-aecd-6ffd891804a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.402640 Jun 24 08:44:40.200027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 51/100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:40.463036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:40.464465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:40.495001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.495777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.497129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.497933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.732697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:40.746389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5bb7b150-fe4e-4c6a-91cf-17d012d52d36 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1502 microversion: 2.1 time: 0.288058 Jun 24 08:44:40.747975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:40 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:40.850700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:40.854689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:40.867038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.867859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:40.869177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:40.871656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.134956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.149394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-327d0a43-7786-417c-9e3e-5b3f4ab0a216 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.307472 Jun 24 08:44:41.150424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 52/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:40 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:41.234814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:41.236197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:41.246533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.247596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.249813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:41.250429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:41.441391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.452178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.453379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:41.454672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d40c9870-87b7-4db8-be7c-c6402092a17c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.229205 Jun 24 08:44:41.455735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 51/103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:42.168370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:42.168957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.172344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:42.176595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.177403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.178373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.178973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.384994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.393120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ae30c9de-b7a7-4f3c-81d5-d105869a4b4a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.228880 Jun 24 08:44:42.393742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:42 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:42.473948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:42.474599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.480922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.481547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.482546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.483314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.730418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.745990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.748324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:42.749977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34ee9d0b-f073-4955-8404-0ff838bcfb7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.280600 Jun 24 08:44:42.764601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 52/105] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:42.786105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd2eea41-5995-42d2-a61a-b368ad5d8e53"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:42.787659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:42.796614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.797368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:42.798893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:42.799934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.413063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:43.413703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:43.422638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.423365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.437304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.438176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.747434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.758114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a364d314-0ee4-4852-9f55-d817713dbeae tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.350780 Jun 24 08:44:43.759567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 53/106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:43 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:43.779448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:43.780577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:43.792496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:43.797883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.797883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.799361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:43.800142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:43.956388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.966477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.967998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:43.969315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5837e3f-d317-4a0b-af84-9b4d1576b856 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.200634 Jun 24 08:44:43.969913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 54/107] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:44.645914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aec7a799-b7c2-4a39-ae4f-c13edd1c7779 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "POST /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.865580 Jun 24 08:44:44.648026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 54/108] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 08:44:42 2022] POST /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3/os-volume_attachments => generated 194 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:44:44.779149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:44.780123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:44.790114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:44.791973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:44.793064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:44.793306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:44.854176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-ba177102-f819-440d-abf3-a63c48c70cc5 req-fbbcda76-bc10-4742-950c-9e359ef68338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fc2b80-e02c-4179-b740-707cd0b41089", "name": "network-vif-plugged", "status": "completed", "tag": "b75490f8-63fa-4519-9fcb-164db7181bf0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:44.871296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-ba177102-f819-440d-abf3-a63c48c70cc5 req-fbbcda76-bc10-4742-950c-9e359ef68338 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:44.872008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-ba177102-f819-440d-abf3-a63c48c70cc5 req-fbbcda76-bc10-4742-950c-9e359ef68338 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:44.885223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-ba177102-f819-440d-abf3-a63c48c70cc5 req-fbbcda76-bc10-4742-950c-9e359ef68338 service nova] Creating event network-vif-plugged:b75490f8-63fa-4519-9fcb-164db7181bf0 for instance 19fc2b80-e02c-4179-b740-707cd0b41089 on hv-cinder-78729 Jun 24 08:44:44.894260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-ba177102-f819-440d-abf3-a63c48c70cc5 req-fbbcda76-bc10-4742-950c-9e359ef68338 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044368 Jun 24 08:44:44.895232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 55/109] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:44.994433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:44.996827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:45.009479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:45.010550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:45.011725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:45.012313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:45.065029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.077321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-21ce353e-7e12-4fa6-b750-116c32b14c78 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.304808 Jun 24 08:44:45.078586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:44 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:45.251999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.265873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.267229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:45.268350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef652b4b-e2b8-4890-87fb-adb54de14e0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.284302 Jun 24 08:44:45.269074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 56/111] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:46.102221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:46.102832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:46.108907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.109352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.110159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.110592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.252598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.260752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e80674d3-2e42-4509-a70f-1f72da8209f4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.162337 Jun 24 08:44:46.261333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:46 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:46.288090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:46.288745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:46.296148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.296579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.297352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:46.297814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:46.434294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.442786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.444455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:46.445638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a9a92de-33a2-4bc6-9443-d48510294393 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.162341 Jun 24 08:44:46.446346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 57/113] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:47.278330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:47.278991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:47.285686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.286367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.287143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.287614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.417428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.425933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1e7829bf-9856-458e-9e73-a3a0d64637e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.151354 Jun 24 08:44:47.426524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 57/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:47 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:47.464451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:47.465075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:47.472131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.472574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.473322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:47.473775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:47.618701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.625354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.626879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:47.628487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5d4ad6bf-7b5f-4dc1-aee6-5fde56ad970e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.167910 Jun 24 08:44:47.629080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 58/115] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:48.443204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:48.443837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:48.451924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.452747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.454195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.454980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.604712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:48.613085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-de5ff821-da0e-4d9a-a346-f3c5092f3455 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.174138 Jun 24 08:44:48.613530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 58/116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:48 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:48.647035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:48.647651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:48.654617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.654963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.655741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:48.656185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:48.803690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:48.812185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:48.813736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:48.815520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a6753907-cfa9-458f-af90-c80d6d55c018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.172426 Jun 24 08:44:48.816096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 59/117] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:44:49.629502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:49.630148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:49.636732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:49.637179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:49.638002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:49.638495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:49.793268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.801130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-74c3abcf-ec25-4dca-8282-558eed7be8e8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.175415 Jun 24 08:44:49.801742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 59/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:49 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:49.834168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:49.834767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:49.841581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:49.842060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:49.842824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:49.843259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:49.981543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.990797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.992460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:49.993857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3c5e3499-d770-4c5b-a941-6acfe75f2a17 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.164335 Jun 24 08:44:49.994691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 60/119] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:50.818015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:50.818633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:50.824630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.825076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.825877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:50.826315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:50.968828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:50.977100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e63038a8-efe8-437c-af4e-ee58a4c0d4db tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.162843 Jun 24 08:44:50.977704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 60/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:50 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:51.012656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:51.013200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:51.020294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.020732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.021495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:51.021947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:51.164410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:51.172673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:51.174180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:51.175556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f1372bc-54a4-4564-be2c-fdf0cb0b91b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.166979 Jun 24 08:44:51.176148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 61/121] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:51.993841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:51.994440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:52.001215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.001653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.002437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.002864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.144770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.152370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2dfc4bc6-e415-43c4-83d6-3a768a7dfb96 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.162330 Jun 24 08:44:52.152947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 61/122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:51 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:52.195456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:52.196071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:52.202932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.203999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.204772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:52.205210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:52.340388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.342723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:52.350677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.352180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:52.353298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f4ad01c9-87d9-45a0-8e34-fca8fefdda76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.162519 Jun 24 08:44:52.353903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 62/123] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:53.170573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.171203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.173608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=64 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:53.179141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.179586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.180366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.180801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.319465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.327224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ee5fd54-3604-49bf-bdaa-fd200e5a3b85 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.161235 Jun 24 08:44:53.327846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 62/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:53 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:53.372906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:53.373516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:53.381754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.382208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.382972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:53.383401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:53.516730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.525509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.527043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:53.528150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-297c9f0b-d48a-4398-8769-6133101e439d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.159538 Jun 24 08:44:53.528721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 63/125] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:54.345170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:54.345807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:54.352329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.352755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.353734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.354164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.538180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:54.548790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-02dbc3df-9490-4f20-8b26-96c6fa6b42ba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.207686 Jun 24 08:44:54.549484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 63/126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:54 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:54.552990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:54.554073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:54.566608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.567690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.568887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:54.569699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:54.781276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:54.789585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:54.791128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:54.792252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b1f2b209-7173-4633-8d1c-a1265efaf18f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.247401 Jun 24 08:44:54.792900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 64/127] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:55.576868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:55.577491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:55.585132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.585582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.586393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.586822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.591211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:55.791280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:55.803582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e9f870ba-dcc0-4198-8466-7af1a03ca180 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.231478 Jun 24 08:44:55.804619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 64/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:55 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:55.816781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:55.818889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:55.832586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.833397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:55.834770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:55.835555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.059616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.079178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.082881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:56.085870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0930a902-4dc5-4659-9893-2236a656aaeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.276685 Jun 24 08:44:56.098099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 65/129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:56.826662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:56.827947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:56.841820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.842675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:56.843749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:56.846797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.130673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:57.131458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:57.143285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.145195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.146256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:57.147617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:57.159434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.175588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a6212c18-96cd-4949-b122-706da5b486a4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.349773 Jun 24 08:44:57.176244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 65/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:56 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:57.510504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.540614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.543043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:57.545285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b4d2b664-14d4-4f33-9683-1cc3a2777337 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.419173 Jun 24 08:44:57.559904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 66/131] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:58.197030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:58.197846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:58.206830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.207279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.208077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.208513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.494785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:58.513638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-33a143ce-0a47-45e9-a9ec-6f92e0baf920 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1322 microversion: 2.1 time: 0.318722 Jun 24 08:44:58.519701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 66/132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:58 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:44:58.576446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:58.578198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:58.587161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.588272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.589864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:58.591259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:58.979147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:59.013130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:59.022637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:59.025595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2f1bd83-9302-45fb-8586-a58e088a011f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.455768 Jun 24 08:44:59.043857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 67/133] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:44:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:44:59.308856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-c99fa953-ae80-489c-92fa-dd4540314191 req-5b0b12b1-919e-45fe-bc42-d386ea9736d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "name": "network-vif-plugged", "status": "completed", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:59.348650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-c99fa953-ae80-489c-92fa-dd4540314191 req-5b0b12b1-919e-45fe-bc42-d386ea9736d6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.349432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-c99fa953-ae80-489c-92fa-dd4540314191 req-5b0b12b1-919e-45fe-bc42-d386ea9736d6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:59.397766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-c99fa953-ae80-489c-92fa-dd4540314191 req-5b0b12b1-919e-45fe-bc42-d386ea9736d6 service nova] Creating event network-vif-plugged:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:44:59.410973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-c99fa953-ae80-489c-92fa-dd4540314191 req-5b0b12b1-919e-45fe-bc42-d386ea9736d6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110486 Jun 24 08:44:59.413348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 67/134] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:44:59.541201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:44:59.544076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:59.561312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.562546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:59.567423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.569990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:59.882066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:44:59.895096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f5ae4669-d9e1-4ea2-9853-11073c0a2470 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1515 microversion: 2.1 time: 0.361597 Jun 24 08:44:59.897693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 68/135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:44:59 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1515 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:44:59.932721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:44:59.936101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:44:59.954755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.956204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:44:59.958619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:44:59.960347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.068974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:00.075076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:00.095358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.096638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.098936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.099908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.179510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lazy-loading 'flavor' on Instance uuid 19fc2b80-e02c-4179-b740-707cd0b41089 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:00.535960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.537231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ca430ce0-8192-4843-9cd4-88a1f3a050b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089/action" status: 200 len: 32 microversion: 2.1 time: 0.613365 Jun 24 08:45:00.545252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 68/136] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:44:59 2022] POST /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089/action => generated 32 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:45:00.561116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:00.561364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.563086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:00.565552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.568098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1f5003c-fdc9-4aed-b566-283d426989ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.511142 Jun 24 08:45:00.585862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.587411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.589163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:00.591243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:00.593077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 69/137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:00.933269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:00.954663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b4ce16f0-469a-4819-964d-8b7d25b03dba tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.405916 Jun 24 08:45:00.976563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 69/138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:00 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:01.628900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:01.632044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:01.653283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.658040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.659541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.660263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.985279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:01.986274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:01.998681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:01.999150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:01.999944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:02.002668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:02.026871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.042154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.047619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.049231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b11e7a4f-1351-4a0a-ba43-0af0c0ea2eb7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1406 microversion: 2.20 time: 0.449944 Jun 24 08:45:02.051333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 70/139] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:02.236466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:02.261080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d02bd819-8da3-491d-8a45-092efe89e19f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.278477 Jun 24 08:45:02.264448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 70/140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:01 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:03.073566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:03.074366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:03.087043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.088014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.089649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.090685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.281297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:03.282048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:03.289053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.289511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.291046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.291766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.304224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.318445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.320005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.321365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a4b55019-d566-4b64-b0f3-90b99ebb85fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1599 microversion: 2.20 time: 0.255637 Jun 24 08:45:03.333901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 71/141] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:45:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1599 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:45:03.343575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:03.344867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:03.359240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.360097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.361492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:03.362298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:03.548905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21b1e50a-1c1d-4a61-8736-b3e8aa5919b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.209421 Jun 24 08:45:03.549584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 72/142] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 24 08:45:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:45:03.563779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:03.593717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-576dad6d-df38-4dcb-83ea-164101ab9b07 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.315877 Jun 24 08:45:03.594943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:03 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:04.645466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:04.647505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:04.656792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.657540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:04.658503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:04.659370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:05.224722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:05.233513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0f8822b9-76da-40bb-882e-bf624da76df5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.602665 Jun 24 08:45:05.234776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 73/144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:04 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:05.797453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-21336e86-d635-47e1-b9f8-1166c8055995 req-4ca6029a-c014-4d65-9b49-0aad4219e3df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:05.817076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-21336e86-d635-47e1-b9f8-1166c8055995 req-4ca6029a-c014-4d65-9b49-0aad4219e3df service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:05.818796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-21336e86-d635-47e1-b9f8-1166c8055995 req-4ca6029a-c014-4d65-9b49-0aad4219e3df service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:05.841821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-21336e86-d635-47e1-b9f8-1166c8055995 req-4ca6029a-c014-4d65-9b49-0aad4219e3df service nova] Creating event network-changed:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:45:05.854156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-21336e86-d635-47e1-b9f8-1166c8055995 req-4ca6029a-c014-4d65-9b49-0aad4219e3df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065289 Jun 24 08:45:05.855392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 72/145] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:06.257037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:06.258602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:06.267769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.268611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.269616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:06.270311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:06.638113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:06.646277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37350be5-559e-4710-984b-546a05a52f80 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.397400 Jun 24 08:45:06.647177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 74/146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:06 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:07.687406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:07.690016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:07.702928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.704189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.705857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:07.706545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:07.918223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:07.940511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a6fbff3d-b950-4632-8a49-76cb96feeb28 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.263382 Jun 24 08:45:07.941940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:07 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:08.968685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:08.969514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:08.979758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.980217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:08.980993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:08.981435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:09.147483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:09.157847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d41010e9-ff10-4307-a3a8-ebcbd51958f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.192997 Jun 24 08:45:09.158628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 75/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:08 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:10.184279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:10.185966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:10.199151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.200214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.201736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.202682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.469547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:10.482058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dbe23beb-ffea-48eb-a21d-853f14a663f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.304262 Jun 24 08:45:10.482724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 74/149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:10 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:10.510226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:10.510842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:10.517899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.518344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.519141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.519599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.547034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:45:10.647567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1928c972-fd10-4007-90dd-a224420de1bb tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 204 len: 0 microversion: 2.1 time: 0.141003 Jun 24 08:45:10.648278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:45:10 2022] DELETE /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:45:10.658623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:10.659417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:10.666973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.667422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.668392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:10.668843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:10.843382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:10.853019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c06d1b4-d652-444c-94f2-1c187d96107d tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.199707 Jun 24 08:45:10.853711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:10 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:11.501467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:11.508032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:11.517218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.518210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.518654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.519434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.750829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:11.759992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5117eb4a-fb73-43a9-9c6a-9aa7f968ecd0 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.263682 Jun 24 08:45:11.760589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 77/152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:11 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:11.874407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:11.876209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:11.885208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.885918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:11.887160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:11.887901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.186395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:12.206647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9bc88df2-c70a-4860-ad6a-3e2a534dec2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.337452 Jun 24 08:45:12.207249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 76/153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:11 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:12.783460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:12.784650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:12.787757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:12.793058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.793589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.794476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:12.795084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:12.822614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:13.032154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:13.051959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-525f1f18-ac6c-4b12-8790-731af01b25c4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.271785 Jun 24 08:45:13.053740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 78/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:12 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:13.224456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:13.225168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:13.231868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:13.232595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:13.233347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:13.233843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:13.394139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:13.408380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d8985690-e1ab-4629-94f9-213c2033b999 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.187434 Jun 24 08:45:13.410686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 77/155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:13 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:14.077106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:14.077923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:14.086475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.088606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.090394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.091078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.306052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:14.322797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b3c1fe2d-a1a3-4672-b5b1-9886c9e6114a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.250252 Jun 24 08:45:14.323917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 79/156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:14 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:14.443411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:14.443411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:14.448965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.449816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.450592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:14.451182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:14.617241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:14.626517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-796aa5ec-5a6b-4c88-8a1f-cbb1420f6d2f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.193150 Jun 24 08:45:14.627173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 78/157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:14 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:15.344660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:15.345611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:15.359252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.359907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.371981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.372489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.631851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:15.645998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba5d8300-5d54-48f0-957e-5ed9ab8af620 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.307880 Jun 24 08:45:15.646972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 80/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:15 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:15.650038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:15.655613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:15.667476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.671681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.671681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:15.671681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:15.877089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:15.893256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee7c1e2f-16eb-470b-9ee8-5402debccabf tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.250115 Jun 24 08:45:15.894856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 79/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:15 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:16.664809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:16.665732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:16.673420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.674230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.675758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.676418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.922067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:16.924507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:16.944345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.945913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.947817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:16.948859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:16.959576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:16.972602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:16.991075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5e6aede7-a0fa-4471-a2fe-bdee337f81a5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.330160 Jun 24 08:45:16.993145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 81/160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:16 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:17.205571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:17.220648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ead5e9b8-8ef6-4ab1-8412-ef3e2ab17ae2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1554 microversion: 2.1 time: 0.312123 Jun 24 08:45:17.222561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 80/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:16 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:18.012819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:18.014563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.029008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.030448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.032157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.033276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.253510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:18.254490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:18.271193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.273628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.276930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.279811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.435553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:18.452155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-923cf585-5b6f-40f0-9e29-51b3ecf2518f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1512 microversion: 2.1 time: 0.208465 Jun 24 08:45:18.457821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:18 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:18.466364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-28245ecc-e4a8-4529-a677-cbd79818da1b req-9c11b6f8-fa99-41d1-bb9d-73f4a60c264f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3", "name": "network-vif-deleted", "tag": "ad1355b1-e2a1-42e2-9c82-29bff6e31e45"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:18.507844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-28245ecc-e4a8-4529-a677-cbd79818da1b req-9c11b6f8-fa99-41d1-bb9d-73f4a60c264f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:18.508590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-28245ecc-e4a8-4529-a677-cbd79818da1b req-9c11b6f8-fa99-41d1-bb9d-73f4a60c264f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:18.537047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-28245ecc-e4a8-4529-a677-cbd79818da1b req-9c11b6f8-fa99-41d1-bb9d-73f4a60c264f service nova] Creating event network-vif-deleted:ad1355b1-e2a1-42e2-9c82-29bff6e31e45 for instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 on hv-cinder-78729 Jun 24 08:45:18.552856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-28245ecc-e4a8-4529-a677-cbd79818da1b req-9c11b6f8-fa99-41d1-bb9d-73f4a60c264f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090026 Jun 24 08:45:18.559615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 82/163] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:18.682409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:18.705052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4604e014-947b-48da-ba07-c50d26857223 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.696540 Jun 24 08:45:18.707907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 82/164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:18 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:19.489870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:19.492628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:19.521608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.522382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.523681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.524408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.694241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:19.725474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:19.726399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:19.731531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-84b36aa4-9811-46ed-9397-065a91810b11 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1346 microversion: 2.1 time: 0.242097 Jun 24 08:45:19.733513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 83/165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:19 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1346 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:19.738458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.739186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.739972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:19.740576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:19.920503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:19.930568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5e7eb26e-1484-47e7-ba21-a31c764435ad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.208566 Jun 24 08:45:19.931201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 83/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:19 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:20.756501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:20.757582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:20.768427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.769114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.770494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.771222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.890560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:20.902353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6cf425d7-47b6-4405-a860-ba8f061c3c1a tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1346 microversion: 2.1 time: 0.151101 Jun 24 08:45:20.903402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 84/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:20 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1346 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:20.957870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:20.959108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:20.970693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.971802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:20.973234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:20.973816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.191202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:21.203290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12e71a90-c3d6-4d99-8ea5-59899a07b08c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.252627 Jun 24 08:45:21.204655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 84/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:20 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:21.926854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:21.927940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:21.939048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.940896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:21.943261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:21.944682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.055831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:22.065453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6401fb7d-687c-4641-b3c0-ddaba0d0958b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1346 microversion: 2.1 time: 0.147238 Jun 24 08:45:22.067275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 85/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:21 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:22.232401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:22.234179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:22.246938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.247756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.249836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:22.250841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:22.553069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:22.567235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60f62da4-7002-48f5-9b92-ba99888062fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.340886 Jun 24 08:45:22.568196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:22 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:23.092552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:23.094104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:23.101082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.101743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.102688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.103208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.199740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:23.209124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dd03b33e-5c11-4dcc-a9cb-bb425952cc2b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1346 microversion: 2.1 time: 0.120800 Jun 24 08:45:23.209765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 86/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:23 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1346 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:23.589389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:23.593871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:23.603994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.605084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.606174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:23.606858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:23.936332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:23.952592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e5a8f006-8204-4dd6-b63e-45a151322d3c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.370161 Jun 24 08:45:23.962497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 86/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:23 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:24.232302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.235114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.247429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=50 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:24.251991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.256540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.259029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.259985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.388233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.389065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.390069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lazy-loading 'fault' on Instance uuid f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:24.474268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8960954266f24a5985d140f5fd0453dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9f6b1d49d54cc2aaa226ae399588b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:24.510926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-13b9b145-646e-4865-9c1d-d595c6c3976b tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 200 len: 1351 microversion: 2.1 time: 0.285679 Jun 24 08:45:24.512684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 87/173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:24 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 1351 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:24.971204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:24.971886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:24.979137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.979856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:24.980661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:24.981102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.152755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:25.164554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6a16b836-2988-4e63-9768-6d53ec084227 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.197598 Jun 24 08:45:25.165568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 87/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:24 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:25.539730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.540860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.548599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.549237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.550451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.551046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.569006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] HTTP exception thrown: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Request method failure captured: Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 HTTP/1.1 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlDE6Rn9Awv7tHk08UN7QqvgMGSnWDFtGEM-cJxyDQIMWuDMKiyGgIZLsK0HcdLVT3yizujGZBdncRb0RWEo_BgLQ31C18mQx4ohJdumZsgPOomoKIxxQ_OKtTiDNU_0m_hLcYR8IYqlQFEihMOrGXlF9mx7ssXkL-VttNyDVYiFuU Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:45:25.573864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 8960954266f24a5985d140f5fd0453dd Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.576192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3'} Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:25.577573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.580121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.583237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Returning 404 to user: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:25.583237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2805b7cf-5950-4553-8ba7-7d5317b92145 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 404 len: 111 microversion: 2.1 time: 0.041580 Jun 24 08:45:25.583237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 88/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:25.764803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:25.765966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:25.781354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.782006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.782681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:25.783124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:25.799853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] HTTP exception thrown: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Request method failure captured: Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3/os-volume_attachments HTTP/1.1 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlDE6Rn9Awv7tHk08UN7QqvgMGSnWDFtGEM-cJxyDQIMWuDMKiyGgIZLsK0HcdLVT3yizujGZBdncRb0RWEo_BgLQ31C18mQx4ohJdumZsgPOomoKIxxQ_OKtTiDNU_0m_hLcYR8IYqlQFEihMOrGXlF9mx7ssXkL-VttNyDVYiFuU Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:45:25.804037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 8960954266f24a5985d140f5fd0453dd Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.805490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3'} Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:25.806301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:25.807888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:25.810282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Returning 404 to user: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:25.811738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-16570e2d-71bd-4367-8557-84a25b009ed2 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051086 Jun 24 08:45:25.812307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 88/176] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:45:25 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:26.193813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:26.194985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:26.211264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.213892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:26.215581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:26.216610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:26.496725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:26.509730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-667a2080-82fe-4284-a145-32888123722c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.324401 Jun 24 08:45:26.510901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 89/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:26 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:27.359645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.360492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.367556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.367895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.368704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.369143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.385454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] HTTP exception thrown: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Request method failure captured: Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 HTTP/1.1 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlDE6Rn9Awv7tHk08UN7QqvgMGSnWDFtGEM-cJxyDQIMWuDMKiyGgIZLsK0HcdLVT3yizujGZBdncRb0RWEo_BgLQ31C18mQx4ohJdumZsgPOomoKIxxQ_OKtTiDNU_0m_hLcYR8IYqlQFEihMOrGXlF9mx7ssXkL-VttNyDVYiFuU Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:45:27.387725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 8960954266f24a5985d140f5fd0453dd Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.389954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': 'f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3'} Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:27.391849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.394160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.396495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Returning 404 to user: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:27.396495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-38d72788-e0bd-4928-a1ea-0cc3f725124f tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 404 len: 111 microversion: 2.1 time: 0.034069 Jun 24 08:45:27.396495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 89/178] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:45:27 2022] DELETE /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:45:27.406215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.408181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] [instance: f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.427730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.428424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.429637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.430393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.450796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] HTTP exception thrown: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Request method failure captured: Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 HTTP/1.1 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlDE6Rn9Awv7tHk08UN7QqvgMGSnWDFtGEM-cJxyDQIMWuDMKiyGgIZLsK0HcdLVT3yizujGZBdncRb0RWEo_BgLQ31C18mQx4ohJdumZsgPOomoKIxxQ_OKtTiDNU_0m_hLcYR8IYqlQFEihMOrGXlF9mx7ssXkL-VttNyDVYiFuU Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:45:27.452385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9e9f6b1d49d54cc2aaa226ae399588b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 9e9f6b1d49d54cc2aaa226ae399588b3 Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-DeleteServersTestJSON-529574061 Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 8960954266f24a5985d140f5fd0453dd Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-DeleteServersTestJSON-529574061-project Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3'} Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:45:27.455607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. Jun 24 08:45:27.458595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:45:27.464939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] Returning 404 to user: Instance f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:45:27.464939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-54717196-28b7-4f06-8154-341d1c880e67 tempest-DeleteServersTestJSON-529574061 tempest-DeleteServersTestJSON-529574061-project] 10.222.0.48 "GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3" status: 404 len: 111 microversion: 2.1 time: 0.055976 Jun 24 08:45:27.464939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 90/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:27 2022] GET /compute/v2.1/servers/f5a2d8a0-d0d2-4fe1-b75c-bc4a073798e3 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:45:27.536186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:27.537065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:27.545850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.547016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.549869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:27.560242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:27.984468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:28.006058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b121cea5-a73f-4b5f-a81f-a8b475087e0a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.473907 Jun 24 08:45:28.014418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 90/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:27 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:29.030717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:29.032162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:29.063331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.064365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.065612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:29.066803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:29.544647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:29.561404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f80a8610-d806-49d5-aa55-772bfe066116 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.538105 Jun 24 08:45:29.575038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 91/181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:29 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:30.617383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:30.619616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:30.655944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.656553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:30.660767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:30.661708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:31.459021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:31.467321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d52ed640-8803-449e-bae1-9f1a1af4efbd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.874350 Jun 24 08:45:31.467941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:30 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:32.491804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:32.494081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:32.529781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.534713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:32.536995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:32.539156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:33.155456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:33.165325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-518c438c-4e10-4f4a-bd4e-0368b1d3461a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.679558 Jun 24 08:45:33.167609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 92/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:32 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:34.204392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:34.205568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:34.229515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.235727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.239068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:34.245979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:34.551898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:34.566456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0194f668-7f8a-4bd3-83e3-449e5f9946d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.373928 Jun 24 08:45:34.570179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 92/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:34 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:35.589035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:35.590577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:35.598595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.599868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.600819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:35.601347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:35.820256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:35.829980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-93428736-e666-4eff-8b6a-3c00b09a7d53 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.245763 Jun 24 08:45:35.831844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:35 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:36.857443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:36.860107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:36.878555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.879836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:36.883109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:36.884841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:37.102580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:37.117901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a68d390e-8988-443f-af09-b4c238a47ec4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.268261 Jun 24 08:45:37.118746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 93/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:36 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:38.143047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:38.144663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:38.153901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.154610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.155736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:38.156333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:38.435293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:38.459076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1890ba1e-1dd1-46c4-ab2f-e576fe1858e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.320662 Jun 24 08:45:38.473903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 94/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:38 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:39.477019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:39.477637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:39.484244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.484702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.485491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:39.485961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:39.767566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:39.779715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79c78226-85ed-4bb6-8b47-0c409fe2a506 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.306729 Jun 24 08:45:39.791424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 94/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:39 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:40.809051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:40.809883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:40.820541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.823294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:40.824279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:40.826615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:41.296496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:41.313706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cc581223-c519-4882-b205-33564c326ec7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.509553 Jun 24 08:45:41.315696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 95/189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:40 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:42.333685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:42.334494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:42.344453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.345214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.346258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:42.347376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:42.570200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:42.591012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3fd80511-5f2d-4413-a035-059d2250d706 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.260743 Jun 24 08:45:42.592965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 95/190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:42 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:42.961728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8782dd7c-600d-4d19-b89c-687c4d7f29d8 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: .version_select at 0x7fa68c243af0>, body: {"keypair": {"name": "tempest-keypair-1422494425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1YO7YccGDVv9Fn9ycCCEoKpZhNgtepL63BO9oR0Fy1rk0XpyRaqJQepUGgJk1rWxgi+7AbxuMZlxx5n/4pXFJBfx1HJ4Lfj7mEalr9eQKd1RZoGRbDm912pIE1chLRuw=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:43.001485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-8782dd7c-600d-4d19-b89c-687c4d7f29d8 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:43.010043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-8782dd7c-600d-4d19-b89c-687c4d7f29d8 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:43.060918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8782dd7c-600d-4d19-b89c-687c4d7f29d8 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273251 Jun 24 08:45:43.061823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 96/191] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:45:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:43.618859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:43.619542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:43.621563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=36 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:43.626757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.627301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.628137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:43.628740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:43.632175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:43.846959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:43.858036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d54b419-7a03-4278-a8d8-0c537bbc87a2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.243168 Jun 24 08:45:43.858964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 96/192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:43 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:44.878300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1979390246", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ee662f5-a7df-4f34-9688-a2bb7bae451c"}], "security_groups": [{"name": "tempest-securitygroup--203884040"}], "key_name": "tempest-keypair-1422494425", "user_data": "}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:44.879788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:44.880481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:44.887285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.887721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:44.888495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:44.888919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.055793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] validate_networks() for [('0ee662f5-a7df-4f34-9688-a2bb7bae451c', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:45:45.136237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:45.154406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-20ad028d-8ea4-4f00-b27c-9f97062a0b72 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.278113 Jun 24 08:45:45.155409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 97/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:44 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:45.759898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:45:45.760521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:45:45.760992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:45:45.761580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:45:45.762152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:45:45.772651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.773205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.774300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:45.774798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:45.803114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:45:45.809460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:45:45.821877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:45:45.824059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:45:45.884606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d1f91649-8bc4-43b7-a433-d7e1a0cbea00 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.015059 Jun 24 08:45:45.885632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 97/194] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:45:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:45:45.902594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5bc41e6e-8b8e-4a2f-8483-570029236143 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:45.903666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5bc41e6e-8b8e-4a2f-8483-570029236143 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:45.994307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5bc41e6e-8b8e-4a2f-8483-570029236143 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.004066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5bc41e6e-8b8e-4a2f-8483-570029236143 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1242 microversion: 2.1 time: 0.108326 Jun 24 08:45:46.015539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 98/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:45 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:46.176833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:46.177732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:46.184660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.185422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.186389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:46.186980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:46.500257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:46.518053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b30e10c8-b128-48cb-b91f-3ab9ac2a8b89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.345131 Jun 24 08:45:46.522920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:46 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:47.023206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:47.024066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:47.032035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.032874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.033816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.034251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.144840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.163159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4a7544bc-3720-49a8-86df-8d37452d662c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1246 microversion: 2.1 time: 0.142045 Jun 24 08:45:47.167523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 99/197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:47 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1246 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:47.548386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:47.549093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:47.555745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.556194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.556970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:47.557436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:47.560617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=94 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:47.752937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:47.761966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-63f8fa4e-d4e2-4d57-97a0-1484c82d1f34 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.217475 Jun 24 08:45:47.762732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:47 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:48.187855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.188600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.196346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.196980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.197802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.198234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.266435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.274214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-572482b9-b5b3-47b0-8ba0-7b6711d056c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1246 microversion: 2.1 time: 0.090199 Jun 24 08:45:48.275053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:48 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:48.779186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:48.780739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:48.788039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.788516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.789323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:48.789792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:48.953485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:48.962794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-13d6ddb5-5d98-428e-a417-188fb10ae9d3 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.187433 Jun 24 08:45:48.963377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:48 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:49.292445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:49.293759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:49.300946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.301432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.302323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.302759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.410528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:49.419082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7562eab2-0c01-4745-ba18-0746dd14115e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1246 microversion: 2.1 time: 0.130349 Jun 24 08:45:49.419800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 101/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:49 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:49.984094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:49.985087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:49.995355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.996799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:49.998117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:49.998753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.184773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.192456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd23119b-e137-4af5-b083-e580a6c4297e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.212865 Jun 24 08:45:50.193046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 101/202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:49 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:50.441880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:50.443014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:50.456214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.456997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.458339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:50.459672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:50.570097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:50.594699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c88a390d-9f6e-4d04-8236-d693fdac600b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1302 microversion: 2.1 time: 0.160732 Jun 24 08:45:50.595708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:50 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:51.218791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:51.219923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:51.227505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.228131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.228969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.229627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.447359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.459802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-15a3111f-1b2f-499f-8c88-5fd16a97d46c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.248614 Jun 24 08:45:51.460685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 102/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:51 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:51.619812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:51.620441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:51.630476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.630966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.631769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:51.632345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:51.734228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:51.744130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2e14a2a0-1bef-4e0c-8f87-c5862e6be1cb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1300 microversion: 2.1 time: 0.129214 Jun 24 08:45:51.745048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 103/205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:51 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:52.486816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.488821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.516820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.527464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.532357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.537555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.761731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:52.762344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:52.775582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.776038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:52.776876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:52.777313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.036663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.056384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0eb3acba-b9cc-4065-b6fd-90a964ff898d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1521 microversion: 2.1 time: 0.576253 Jun 24 08:45:53.067857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:53.223974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:53.236066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fcadcb20-09a1-47ea-a298-1fe61c169110 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.478175 Jun 24 08:45:53.238210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 104/207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:52 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:53.784060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-824f4bd1-7258-4d16-9fa8-a0046bda804f req-a592b405-4c79-496e-a270-178038e74d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e738abd4-3c88-4daf-a1a5-0ff726682731", "tag": "35c95a9d-d09e-4021-b15c-16d9c3196a06"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:53.804221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-824f4bd1-7258-4d16-9fa8-a0046bda804f req-a592b405-4c79-496e-a270-178038e74d06 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:53.804752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-824f4bd1-7258-4d16-9fa8-a0046bda804f req-a592b405-4c79-496e-a270-178038e74d06 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:53.836342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-824f4bd1-7258-4d16-9fa8-a0046bda804f req-a592b405-4c79-496e-a270-178038e74d06 service nova] Creating event network-changed:35c95a9d-d09e-4021-b15c-16d9c3196a06 for instance e738abd4-3c88-4daf-a1a5-0ff726682731 on hv-cinder-78729 Jun 24 08:45:53.843475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-824f4bd1-7258-4d16-9fa8-a0046bda804f req-a592b405-4c79-496e-a270-178038e74d06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068612 Jun 24 08:45:53.848970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 104/208] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:45:54.087647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:54.088269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:54.111743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.112120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.116017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.118580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.256433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:54.259447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:54.272846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:54.275944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.277513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.280070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.281971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.487394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.504178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fff628ba-b18b-4764-884a-92418cf988d7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1501 microversion: 2.1 time: 0.425092 Jun 24 08:45:54.508860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 105/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:54 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1501 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:54.534648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:54.535434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:54.555175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.559392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.564427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:54.565132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:54.617225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.630013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8270ef47-2f10-4b08-9fb6-540b63a00fe3 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.376035 Jun 24 08:45:54.631953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:54 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:54.817279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:54.826873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a15d95d1-7f12-4572-a3ea-9381fb8ed410 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1515 microversion: 2.1 time: 0.295865 Jun 24 08:45:54.827482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 106/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:54 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:45:55.652418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:55.653240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:55.660196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:55.661389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:55.662432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:55.662983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:55.782058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:55.819257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=10 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:55.863095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:55.877384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3aa46908-237a-4dba-9b16-ef85ed6f4478 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.228762 Jun 24 08:45:55.878336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:55 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:56.898337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:56.901343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:56.907929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.928765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.932017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:56.934884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:56.935658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.370034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:57.378237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47fb0c63-e39e-48b7-82e7-ed57a19f28a7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.486669 Jun 24 08:45:57.386584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 107/213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:56 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:57.513093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:45:57.516073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:57.529548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.529548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.530338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.530745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.582545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lazy-loading 'flavor' on Instance uuid 8717b2ef-e244-4d90-a381-3afddfc2833e {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:45:57.796242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ee94992-8dc4-4ece-9adf-8fd302463e0b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/action" status: 200 len: 32 microversion: 2.1 time: 0.289494 Jun 24 08:45:57.802032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 107/214] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:45:57 2022] POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/action => generated 32 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 08:45:57.817358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:57.819620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:57.843563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.844586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:57.848009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:57.849293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.423275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:58.427337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:58.446692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.462074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.468590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.471071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:58.473894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a398eaa-1cea-4bcf-b9fd-b7d3ecc134a9 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.668903 Jun 24 08:45:58.475448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:58.476871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 108/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:57 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:58.850533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:58.863007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-736f7994-7167-425d-9c8b-d3ff1364e8c1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.459768 Jun 24 08:45:58.875640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 108/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:58 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:59.499498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:59.504089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:59.538193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.538193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.539080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.539433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.823208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:45:59.834331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8158aab4-5e90-4039-af21-3067a962deb4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.343427 Jun 24 08:45:59.849892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 109/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:59 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:45:59.884671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:45:59.886110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:45:59.902968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.903271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:45:59.904087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:45:59.916719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:00.361848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:00.380489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f0c1a2c4-cf71-48da-8df3-d1c2dcc2822a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.499009 Jun 24 08:46:00.390312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 109/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:45:59 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:00.856394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:00.860398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:00.881101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.882147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:00.883160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:00.883814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.398356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:01.399007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:01.416564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:01.417165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.425610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:01.429509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:01.760301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:01.770261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2e999483-4469-40e2-a31d-4a14417a1e7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.917576 Jun 24 08:46:01.770930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 110/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:00 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:02.025209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:02.037773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e2d885f7-c93e-45cb-ac33-5664cb6d8995 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.641310 Jun 24 08:46:02.038373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 110/220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:01 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:02.809709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:02.811348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:02.827306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.828057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:02.829883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:02.831189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.065926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:03.066558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:03.086712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:03.087229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.088071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:03.088511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:03.556471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.586792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-868edca9-5fed-45e5-90c3-98bc3623153f tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.783893 Jun 24 08:46:03.590449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 111/221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:02 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:03.746237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:03.755030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-03d94bdb-ad75-4890-af62-df846005dc14 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.693588 Jun 24 08:46:03.762436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 111/222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:03 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:04.612471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:04.622292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:04.639780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.641409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.648492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.649293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.780746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:04.781466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:04.792987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.793437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.794259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:04.794692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:04.999458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.015451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a6f4ddc-64b1-4fa9-996f-6a4168f125c6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.411501 Jun 24 08:46:05.016067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:04 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:05.090830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:05.106678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-54fbbed7-2d9e-4faa-8bf6-275e943ca2d4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.329077 Jun 24 08:46:05.107319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 112/224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:04 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:06.036118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:06.037435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:06.056498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.057280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.063788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.064844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.124430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:06.125241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:06.171703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.175798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.177158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.180855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.629928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:06.663769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8df4e8a1-bb00-48e0-a05a-7429e9376932 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.543546 Jun 24 08:46:06.664710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 113/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:06 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:06.686018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-15071de7-32e7-44cb-b9ac-24e17ad124ad req-d9720305-deb4-45fc-9ac6-8200fa479d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e738abd4-3c88-4daf-a1a5-0ff726682731", "name": "network-vif-plugged", "status": "completed", "tag": "35c95a9d-d09e-4021-b15c-16d9c3196a06"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:06.712723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-15071de7-32e7-44cb-b9ac-24e17ad124ad req-d9720305-deb4-45fc-9ac6-8200fa479d9c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:06.722581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-15071de7-32e7-44cb-b9ac-24e17ad124ad req-d9720305-deb4-45fc-9ac6-8200fa479d9c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:06.770433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-15071de7-32e7-44cb-b9ac-24e17ad124ad req-d9720305-deb4-45fc-9ac6-8200fa479d9c service nova] Creating event network-vif-plugged:35c95a9d-d09e-4021-b15c-16d9c3196a06 for instance e738abd4-3c88-4daf-a1a5-0ff726682731 on hv-cinder-78729 Jun 24 08:46:06.787858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-15071de7-32e7-44cb-b9ac-24e17ad124ad req-d9720305-deb4-45fc-9ac6-8200fa479d9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121041 Jun 24 08:46:06.788942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 114/226] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:06.844352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:06.847688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:06.868133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85c503bd-7467-4ffc-b0d0-4fccde32dce6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.834793 Jun 24 08:46:06.869594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:06 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:07.696355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:07.698103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:07.721321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.722884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:07.723705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.724146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:07.730745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:07.886068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:07.887452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:07.895656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.896484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:07.897543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:07.898257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:07.948047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:07.961327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c06be32c-4f57-49b0-a8a8-f59912a40ecc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.276654 Jun 24 08:46:07.966393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 115/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:07 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:08.296671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:08.320809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8236600c-d646-42a2-b185-6262c3c8af52 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.436494 Jun 24 08:46:08.326100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:07 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:08.981882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:08.982530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:08.991779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:08.992167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:08.992957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:08.993420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.338929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:09.340391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:09.351689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.359021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.362478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:09.365060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:09.795710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.810336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-198e6905-5419-41c3-92b4-600a14b2dc83 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.833215 Jun 24 08:46:09.826145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 116/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:08 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:09.869676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:09.893203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fb207ffe-71c6-49a8-b410-c8b4970a92d4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.558646 Jun 24 08:46:09.899162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:09 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:10.833935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:10.834588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:10.857125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.858348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:10.866995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.871745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:10.923314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:10.923314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:10.941430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.944577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:10.946467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:10.955987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:11.831540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:11.842671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1741ab5e-f809-4ae5-b9ac-845edcba70c6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 1.014073 Jun 24 08:46:11.847605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:10 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:12.018253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:12.038893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba2c2daf-a44b-47ba-af5a-6197f3af30df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 1.126617 Jun 24 08:46:12.043844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:10 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:12.866822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:12.868226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:12.891540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:12.893897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:12.894965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:12.900472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:13.073956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:13.075318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:13.087249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:13.087824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:13.096517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:13.097052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:13.729331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:13.741623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e71ff718-56a9-461e-823f-72f17d734b87 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.671877 Jun 24 08:46:13.742951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:13 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:13.761369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:13.770554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8bd48a1d-7cbd-4b90-99af-32f61459bbff tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1367 microversion: 2.1 time: 0.907932 Jun 24 08:46:13.775235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 118/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:12 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1367 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:14.765900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:14.767429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:14.778709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=46 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:14.780329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.780848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:14.781968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.782411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:14.799552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:14.800760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:14.820679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.821140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:14.822069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:14.822541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:15.341321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:15.356765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f284861b-618a-494b-8d95-302f5b3fc7ea tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.599656 Jun 24 08:46:15.367387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 118/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:14 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:15.429006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:15.449316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-92fa8e14-386b-4f47-9d58-20ef874616cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1558 microversion: 2.1 time: 0.653877 Jun 24 08:46:15.471634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:15.473252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:15.473843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 119/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:14 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1558 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:15.493392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:15.494088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:15.495400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:15.496016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:15.714821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c5c14ba8-1882-4b39-84d9-01152af457ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247814 Jun 24 08:46:15.722658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 119/238] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 08:46:15 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:46:16.385922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:16.387423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:16.402141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:16.402598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:16.403397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:16.403835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:16.868875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:16.883411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2957af90-d0d4-4487-b3e8-a6dff9ee2593 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.503302 Jun 24 08:46:16.889401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 120/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:16 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:17.395322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fc28dee2-ead7-4695-bde2-4a636806bbf7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Action: 'create', calling method: .version_select at 0x7fa68c2735e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1024103265", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKI8b/teaJrqdBlmB8gZYMdyxhz7qxleWOfLd4KVm8dJ08K40hmIiwzhXSO2AFa4GHOHK4cxikT9lRejPstQk6932Zl5PptDU0qa44IaZrbqy6OupQiAj4kdROP3hTyJQ=="}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:17.454862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-fc28dee2-ead7-4695-bde2-4a636806bbf7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Getting quotas for project 315d35baa7c248a99083fc857a7e09e6. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:17.472330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-fc28dee2-ead7-4695-bde2-4a636806bbf7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Getting quotas for user ca8b46b6c10644dcb5891acd98f1e5fb and project 315d35baa7c248a99083fc857a7e09e6. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:17.526030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fc28dee2-ead7-4695-bde2-4a636806bbf7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.846703 Jun 24 08:46:17.534161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 120/240] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:46:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:17.907781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:17.908396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:17.934942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:17.936149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:17.944367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:17.945204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:18.491439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:18.556619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3deaaed8-d7ac-4c7f-ac14-09d610d9b5ec tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.654822 Jun 24 08:46:18.566247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 121/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:17 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:19.556693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-5639ff21-40f0-4589-a4f4-c5b8a8183c75 req-d8e1f9b1-a415-4d28-861e-5cf157974bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e738abd4-3c88-4daf-a1a5-0ff726682731", "tag": "35c95a9d-d09e-4021-b15c-16d9c3196a06"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:19.587438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:19.588754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:19.628419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-5639ff21-40f0-4589-a4f4-c5b8a8183c75 req-d8e1f9b1-a415-4d28-861e-5cf157974bc4 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:19.628869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-5639ff21-40f0-4589-a4f4-c5b8a8183c75 req-d8e1f9b1-a415-4d28-861e-5cf157974bc4 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:19.635642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:19.640386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:19.648643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:19.656703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:19.662329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-5639ff21-40f0-4589-a4f4-c5b8a8183c75 req-d8e1f9b1-a415-4d28-861e-5cf157974bc4 service nova] Creating event network-changed:35c95a9d-d09e-4021-b15c-16d9c3196a06 for instance e738abd4-3c88-4daf-a1a5-0ff726682731 on hv-cinder-78729 Jun 24 08:46:19.675753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-5639ff21-40f0-4589-a4f4-c5b8a8183c75 req-d8e1f9b1-a415-4d28-861e-5cf157974bc4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155442 Jun 24 08:46:19.681879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 121/242] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:20.652186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:20.663387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1d5113f5-d24c-4fd1-b08c-f541cb3e01f6 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 1.082433 Jun 24 08:46:20.664419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 122/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:19 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:21.681565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:21.682651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:21.698613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:21.708116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:21.711719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:21.719683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:22.244538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:22.277763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f73fafa-8783-40f3-b647-b22ad5c24f89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.598082 Jun 24 08:46:22.280057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 122/244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:21 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:23.306162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:23.307143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:23.318319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.320478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.322413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.323605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.797537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:23.848948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d5b2db1a-8b65-462b-9b3a-820ecb0574b2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1501 microversion: 2.1 time: 0.546584 Jun 24 08:46:23.854488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 123/245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:23 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1501 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:23.876736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b91e1733-100a-4faa-beb3-bc69c5c398b2"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:23.878562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:23.893090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.893545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.904588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:23.905071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:23.956903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Cannot 'attach_volume' instance 8717b2ef-e244-4d90-a381-3afddfc2833e while it is in vm_state rescued Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/os-volume_attachments HTTP/1.1 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 74 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:46:23.964199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {"volumeAttachment": {"volumeId": "b91e1733-100a-4faa-beb3-bc69c5c398b2"}} Jun 24 08:46:23.966203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Cannot 'attach_volume' instance 8717b2ef-e244-4d90-a381-3afddfc2833e while it is in vm_state rescued Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': '8717b2ef-e244-4d90-a381-3afddfc2833e', 'body': {'volumeAttachment': {'volumeId': 'b91e1733-100a-4faa-beb3-bc69c5c398b2'}}} Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:46:23.967105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8717b2ef-e244-4d90-a381-3afddfc2833e while it is in vm_state rescued Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:46:23.968344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:46:23.969508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:46:23.969508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:46:23.969508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8717b2ef-e244-4d90-a381-3afddfc2833e while it is in vm_state rescued Jun 24 08:46:23.969508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:46:23.971213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 409 to user: Cannot 'attach_volume' instance 8717b2ef-e244-4d90-a381-3afddfc2833e while it is in vm_state rescued {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:46:23.974147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c3ed94a6-4e9b-4516-92f1-87b70c011b7b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.101957 Jun 24 08:46:23.976135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 123/246] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 08:46:23 2022] POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/os-volume_attachments => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 08:46:24.006184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:24.008101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:24.026593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.028369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.031596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.032813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.151453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-30a4c810-5d6f-4125-b0f6-791e4231fc00 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/action" status: 202 len: 0 microversion: 2.1 time: 0.168948 Jun 24 08:46:24.158429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 124/247] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:46:23 2022] POST /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:46:24.167504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:24.168178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:24.176358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.177143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.178332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:24.179211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:24.674241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:24.690571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b6e61743-7887-43b3-b3c6-40fb817e4fa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.523416 Jun 24 08:46:24.695731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:24 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:25.732139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:25.735693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:25.750928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=40 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:25.754307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.755245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:25.760263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:25.761050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:26.034194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:26.051475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-981e37da-92b2-44cd-a63e-7de146f8f3f5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.333903 Jun 24 08:46:26.053117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 125/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:25 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:27.083145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:27.084036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:27.090747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.092144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:27.093219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:27.093929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:27.368390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:27.383989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01df6c2b-fdf2-4381-bfd2-0e4be9b16ad4 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.305354 Jun 24 08:46:27.393548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 125/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:27 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:28.410050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:28.410665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:28.427016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:28.428614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:28.429711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:28.430336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:28.841425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:28.850116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b9ef341d-5af3-467e-9e50-b13fdbff11fa tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.443869 Jun 24 08:46:28.850716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 126/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:28 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:29.870521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:29.874322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:29.884536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:29.890065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.890948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:29.892547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:29.893382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:30.081150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:30.098459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46519eb5-e088-42c1-a169-2e58e1f0f06c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.233813 Jun 24 08:46:30.100162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 126/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:29 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:31.130202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:31.132332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:31.147953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:31.148712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:31.150441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:31.155969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:31.483844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:31.513703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-80ce47b0-a283-4dab-8fe5-456a236c3185 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.384729 Jun 24 08:46:31.514794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 127/253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:31 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:32.534328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:32.535358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:32.546058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.546764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.547694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:32.548241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:32.781956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:32.790941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-568e37f6-d8cf-436d-913e-30077fbc4070 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.262464 Jun 24 08:46:32.801342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 127/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:32 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:33.814308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:33.821084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:33.858145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.862557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:33.864613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:33.865262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:34.114835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-440563596", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:34.143396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:34.179301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c807b3bc-9214-4a67-a4e7-606a528f117c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1509 microversion: 2.1 time: 0.373358 Jun 24 08:46:34.180756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 128/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:33 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:35.210637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:35.211890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:35.233857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.234846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.236276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:35.237258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:35.606044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:35.619949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6c5892c9-4a9a-467d-9907-40b1d79e9dda tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1515 microversion: 2.1 time: 0.419128 Jun 24 08:46:35.641566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 129/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:35 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1515 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:36.584927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ecc11955-f0ed-4b4c-8133-30ae5267792b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'create', calling method: .version_select at 0x7fa68c204e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-154716723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWqdpOVUXhkRNNtj8oODA7tMsarHH2GqrNsQYZ5efjc6doJRkqtO2PNLN2TXTWxWun0eOrqkYE7jsTJTks+cVvTa7Oj7CoHmHdwoQLecNPU/+5LER97FhIk47hx1kif9A=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:36.615800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-ecc11955-f0ed-4b4c-8133-30ae5267792b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Getting quotas for project 4a09ac9cce354a3581d69b8edc154f7c. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:36.621574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-ecc11955-f0ed-4b4c-8133-30ae5267792b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Getting quotas for user 323d30d600274919915b968252a1ee77 and project 4a09ac9cce354a3581d69b8edc154f7c. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:36.625484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] validate_networks() for None {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:46:36.657577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ecc11955-f0ed-4b4c-8133-30ae5267792b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.080126 Jun 24 08:46:36.665825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 130/257] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:46:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:46:36.815881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-631551880", "imageRef": "8b6c3d65-504b-4e78-8edd-5ee6591cbef8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-154716723", "networks": [{"uuid": "66a47be1-fe90-443a-bb46-3d3407c4b76a"}]}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:36.904781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] validate_networks() for [('66a47be1-fe90-443a-bb46-3d3407c4b76a', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:46:37.051694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:46:37.052531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:46:37.053413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:46:37.054215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:46:37.054900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:46:37.070541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.071384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.072890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.074240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.086849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=72 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:37.101934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Getting quotas for project 387d792bae064f11abdf2f66de730af0. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:37.106926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Getting quotas for user 1a1727db0ff34df791d23edd53e2590d and project 387d792bae064f11abdf2f66de730af0. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:37.120661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:46:37.123061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:46:37.186287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ce69176d-fc66-4280-9fcf-68e1d748078d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.079555 Jun 24 08:46:37.187597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 128/258] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:46:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:46:37.197851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e8f66bca-a6e4-48b4-925f-434b01247f52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:37.199088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e8f66bca-a6e4-48b4-925f-434b01247f52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:37.312587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e8f66bca-a6e4-48b4-925f-434b01247f52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.321897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e8f66bca-a6e4-48b4-925f-434b01247f52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1214 microversion: 2.1 time: 0.128051 Jun 24 08:46:37.323151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 129/259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:37 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:37.478514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:46:37.480384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:46:37.481265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:46:37.486113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:46:37.486879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:46:37.512206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.512710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.514389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:37.515601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:37.554067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Getting quotas for project 4a09ac9cce354a3581d69b8edc154f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:37.567783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Getting quotas for user 323d30d600274919915b968252a1ee77 and project 4a09ac9cce354a3581d69b8edc154f7c. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:37.593441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:46:37.598018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b6c3d65-504b-4e78-8edd-5ee6591cbef8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:46:37.686422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6309b28-d40a-41bb-817a-895f02c25b58 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: .version_select at 0x7fa68c4be1f0>, body: {"keypair": {"name": "tempest-keypair-1220660037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm2fpyMWrkCYmT8axcb9V3nSHwJ1Ad4dcAP+O6cHu2bAvaelKulUxKj/I5BmKobPGY+WvkSCOEi/2BHM3HYVlQkMBQu532hymb0uQhU9xoWkmjEKQfHJvRzm9WudSWiqA=="}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:37.704654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0d8c8952-2d8d-42d8-ac6e-7e6df75f5838 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892870 Jun 24 08:46:37.706473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 131/260] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:46:37.707247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-c6309b28-d40a-41bb-817a-895f02c25b58 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:37.716719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-c6309b28-d40a-41bb-817a-895f02c25b58 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for user 7152500089314edea337b9a58830f12d and project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:37.722139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2b5b9f15-a9d7-484f-9183-55d2daa52ce2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:37.722966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2b5b9f15-a9d7-484f-9183-55d2daa52ce2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:37.769478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c6309b28-d40a-41bb-817a-895f02c25b58 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090080 Jun 24 08:46:37.770555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 130/261] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:46:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:46:37.872692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2b5b9f15-a9d7-484f-9183-55d2daa52ce2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:37.885547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2b5b9f15-a9d7-484f-9183-55d2daa52ce2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1257 microversion: 2.1 time: 0.171963 Jun 24 08:46:37.888087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 132/262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:38.349385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.353279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.367388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.368283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.369538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.373440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.492234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:38.504114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1be39061-b264-489d-8261-d63e5959ca98 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1266 microversion: 2.1 time: 0.166612 Jun 24 08:46:38.504625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 131/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:38.926873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:38.930058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:38.943511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.944785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.948444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:38.949933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:38.960293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:39.117993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.136004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-28ee34b9-5ca6-4548-9131-e1a578f85b5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1253 microversion: 2.1 time: 0.223283 Jun 24 08:46:39.137640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 133/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1253 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:39.529594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:39.531336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:39.541127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.542241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.543747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:39.544677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:39.621954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:39.631456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-394e3f20-7d3e-4d8c-a0c5-514ab6c084dc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1272 microversion: 2.1 time: 0.111283 Jun 24 08:46:39.632382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 132/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:39 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:40.155422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.156881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.165633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.168444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.183282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.185371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.362060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.378955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-533268d8-8205-4da5-8d17-1207fcc83fe6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1315 microversion: 2.1 time: 0.228142 Jun 24 08:46:40.381173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 134/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:40.661260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:40.662892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:40.677713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.678650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.680250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:40.680943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:40.834947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:40.851645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-694529ea-2bee-4cb5-b1cd-0bf7c1dda8f6 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1272 microversion: 2.1 time: 0.198282 Jun 24 08:46:40.852227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 133/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:40 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:41.290385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-277477151", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1dee5e65-a25a-406c-88bc-d2e389f155d0"}], "security_groups": [{"name": "tempest-securitygroup--1186050135"}], "key_name": "tempest-keypair-1220660037", "user_data": "}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:46:41.408208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.408756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.434328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.434823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.435631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.436067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.703157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:41.730914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b078d86-b1fb-464c-87f2-48723d15ae19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.333433 Jun 24 08:46:41.737383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 134/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:41.877640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:41.878300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:41.884607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.885586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:41.886395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:41.886831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.055469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.065541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a4db8b9d-b87f-4b89-b674-b2cea5252b70 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.193516 Jun 24 08:46:42.067659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 135/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:41 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:42.753348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:42.757095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:42.761588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.762077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.762913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:42.763360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:42.980265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:42.990833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a12adc51-5e8a-45c2-aad2-36202ea31330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.241265 Jun 24 08:46:42.991428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 136/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:43.090574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:43.091861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:43.099658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.100403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.101795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:43.102262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:43.278161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:43.286843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d859ce2e-bc59-4731-b1cd-b67037f9591c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.205459 Jun 24 08:46:43.287428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 137/271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:43 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:44.020712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:44.022045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:44.045205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.045700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.046509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.046961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.211105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:44.223885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-96dd6611-fcff-4559-b02d-9c781b379444 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.211670 Jun 24 08:46:44.224492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:44.308880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:44.309721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:44.317023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.317469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.318299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:44.318738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:44.473953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:44.483623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-45a68504-e208-41ee-a9e6-9ab53e2cfd14 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.179742 Jun 24 08:46:44.493900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 139/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:44 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:45.135118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] validate_networks() for [('1dee5e65-a25a-406c-88bc-d2e389f155d0', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:46:45.248940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:45.250477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.252802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:45.260050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.264515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.267875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.268533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.670517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:45.711427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e74cb6f4-562e-4480-8067-88a5856612a1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.468835 Jun 24 08:46:45.712375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 140/274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:45.739071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:45.740464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:45.755712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.757165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:45.760315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:45.761522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.078956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.088694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-55fcd0ee-926b-4b3f-a05f-ba8e0f5baf22 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.367674 Jun 24 08:46:46.089296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 141/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:45 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:46.097186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:46:46.097978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:46:46.098825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:46:46.099476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:46:46.100060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:46:46.111721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.112375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.113244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.113800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.134164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:46:46.139525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Getting quotas for user 7152500089314edea337b9a58830f12d and project 9620da2622aa454ea30ccf09edf6b1f8. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:46:46.153316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:46:46.155716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:46:46.241777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-22c05581-2784-4bb8-9604-4771294cd57a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.957028 Jun 24 08:46:46.243498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 135/276] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:46:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 4960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:46:46.261442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b67df61-3d40-41d2-bbab-5e92f33de347 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.262786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b67df61-3d40-41d2-bbab-5e92f33de347 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.347220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b67df61-3d40-41d2-bbab-5e92f33de347 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:46.354103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b67df61-3d40-41d2-bbab-5e92f33de347 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1245 microversion: 2.1 time: 0.100808 Jun 24 08:46:46.354836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 142/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:46.735451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:46.736433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:46.764605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.765051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:46.765888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:46.778227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.015728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:47.023826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dcfaad0b-ce38-45c0-8703-f8b3044ab32f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.294359 Jun 24 08:46:47.024407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 136/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:47.108919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:47.109903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:47.111899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:47.121374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.121942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.122752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.123191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.303946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:47.313587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c61c68d4-b154-4220-8236-a2de5424dfe0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.208858 Jun 24 08:46:47.314358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 143/279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:47 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:47.372295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:47.373392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:47.380401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.380964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.381770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:47.382200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:47.453238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:47.469108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c770ec92-ae71-48dd-9967-5a2b271d0de1 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.101100 Jun 24 08:46:47.470641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 137/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:47 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:48.041333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:48.041975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:48.048518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.048967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.049776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.050213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.206930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.215677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7802b5d9-12ec-447b-8b83-be0d8ab3ea33 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.178216 Jun 24 08:46:48.216273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 144/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:48.337799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:48.338518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:48.357407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.359323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.361238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.362013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.496846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:48.499389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:48.511431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.512047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.512869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:48.513443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:48.519028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.538019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5cb4d2e8-fb0c-4f1f-ba76-98179d0c4604 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.204238 Jun 24 08:46:48.542708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 138/282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:48 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:48.586252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:48.595563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a9147db2-2bce-43a2-8a2f-83b0ef738aa8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.108405 Jun 24 08:46:48.596242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 145/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:48 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:49.235208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.236376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.244235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.244235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.247083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.247083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.423515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.431857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-72778844-2f38-491e-86c2-b7e67187daa7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.202416 Jun 24 08:46:49.443321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 139/284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:49.565939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.567867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.579984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.581173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.584778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.588393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.615866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:49.616917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:49.632025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.632479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.633266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:49.633762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:49.737810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.750802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b9c2724f-75d7-47f3-918d-14ad7f003357 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.141600 Jun 24 08:46:49.751935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 140/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:49.818525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:49.827541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6c6bf8b9-24b1-46a6-8612-d1c51dad2dfc tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.270193 Jun 24 08:46:49.828167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 146/286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:49 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:50.453062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:50.454473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:50.464554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.465188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.466168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.466713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.618822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:50.627905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5225ff2e-0d73-491d-803c-df6221ba035a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.181483 Jun 24 08:46:50.628498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 141/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:50.777989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:50.778670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:50.784976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.785425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.786229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.786663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.854424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:50.856772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:50.870277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.870726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.882686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:50.883273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:50.907089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:50.933937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6868c101-883d-4276-9273-e393874f3736 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.163420 Jun 24 08:46:50.934921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 147/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:50 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:51.098888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.109895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4987b873-edaf-46c4-bed9-9b353a9b7b52 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.264396 Jun 24 08:46:51.110584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 142/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:50 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:51.646492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.647220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.654559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.655355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.656358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.656989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.687900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:51.844375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:51.852892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e1ab3bb2-147c-4101-9887-3f7d553c620e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.210570 Jun 24 08:46:51.853483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 148/290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:51.956667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:51.958041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:51.964874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.965327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:51.966159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:51.966595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.043030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.053499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5064e427-6064-4e1b-8fc4-3cb45d77b9fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.104405 Jun 24 08:46:52.054400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 143/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:51 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:52.128606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:52.129590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:52.147898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.148503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.150056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.150596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.318228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:52.326945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c9254b06-aa43-447f-9368-bb2f0b8a6373 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.202124 Jun 24 08:46:52.327554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 149/292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:52 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:52.877988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:52.878748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:52.885441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.885925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:52.886694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:52.887121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.044933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.053124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-076ce815-ffb2-4836-99da-00f791cf8644 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.179245 Jun 24 08:46:53.053775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 144/293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:53.075336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:53.076008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:53.083027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.083474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.084256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.084751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.162652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.170442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3113f8c4-f22b-4921-8993-df63c9cc699a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.100933 Jun 24 08:46:53.171029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 150/294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:53 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:53.343966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:53.344485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:53.352282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.352730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.353531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:53.354008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:53.496328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:53.504868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-36e9800e-90ef-46a8-aeff-3b401dad3a46 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.164828 Jun 24 08:46:53.505727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 145/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:53 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:54.070312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.070931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.077471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.078176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.078718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.079157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.189242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.190377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.196735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.197340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.197997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.198431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.222148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:54.239880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3353f7c6-239d-4478-a512-b93d71da940c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.173343 Jun 24 08:46:54.240481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 151/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:54.267149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:54.276124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2c1d4ad4-5326-4a05-bbd4-00e9c2a07c1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.092136 Jun 24 08:46:54.276720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 146/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:54.527813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:54.528425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:54.534572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.535062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.535837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:54.536277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:54.697551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:54.712297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3b045f3a-cc10-409c-b195-ae368e2390b0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.188723 Jun 24 08:46:54.713463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 152/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:54 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:55.259117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.260341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.266906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.267474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.268457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.269086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.296498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.298112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.306191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.306458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.307296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.307800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.390519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.399511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-181a4f27-28d3-4522-a8f2-94898b4b9dca tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.107512 Jun 24 08:46:55.400373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 153/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:55 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:55.470316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.478452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e05440a9-f6b8-4589-b579-6760dd3e5c90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.224636 Jun 24 08:46:55.479040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 147/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:55.737487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:55.738326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:55.745097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.745557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.746375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:55.746813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:55.878720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:55.887030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f8187ab0-a0f0-497c-89ad-72bb1c5844e2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.153441 Jun 24 08:46:55.887607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 154/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:55 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:56.418910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:56.419500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:56.421729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:56.422400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=18 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:56.423064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:56.428988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.429430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.430866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.431294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.496646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:56.496646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:56.498540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.499225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=14 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:56.504994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.505443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.506245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.506483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ebd803cf-6c01-4ead-9497-e0f147739ffe tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.091436 Jun 24 08:46:56.506684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.507072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 148/302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:56 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:56.859556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:56.867160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3115f420-8401-4d7b-91ce-ee49e51a9513 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.375594 Jun 24 08:46:56.867737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 155/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:46:56.904513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:56.905170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:56.911832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.912278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:56.913041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:56.913478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.055143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.062451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f854d988-fc04-4a4e-a238-2c2f30b180a5 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.161857 Jun 24 08:46:57.063007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 149/304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:56 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:57.523457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:57.524061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:57.530559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.531002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.531753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.532181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.593008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:57.600612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-35bf8725-a70a-4cd1-8f20-da2b130b750d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.081153 Jun 24 08:46:57.601175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 156/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:57 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:57.883714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:57.884316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:57.890908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.891348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.892110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:57.892533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:57.909292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:58.036041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:58.044365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8f6b1f7-9e02-4e75-b82a-fef8079c9c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.164465 Jun 24 08:46:58.044944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 150/306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:58.079877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.080554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.089391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.089979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.090917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.091558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.226171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:58.234573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7069b647-ba0f-4b57-b1bb-f27b2abde232 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.158722 Jun 24 08:46:58.235148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 157/307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:58 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:58.616522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:58.617133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:58.623318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.623761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.624532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:58.624965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:58.686054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:58.693461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-946dfb4b-10a8-45ff-ac08-cbb2ccdc7dbf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.080807 Jun 24 08:46:58.694058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 151/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:58 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:59.061385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.062021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.068515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.068960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.069747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.070764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.207772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.215848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a2df4e1-7ebb-456a-a304-2571db9d3a7a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.158435 Jun 24 08:46:59.216412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 158/309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:59.252630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.253313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.260070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.260510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.261279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.261740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.391999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.400200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6946a87d-9b54-4485-b4c5-25834186082c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.152063 Jun 24 08:46:59.400685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 152/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:59 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:46:59.710898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:46:59.711418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:46:59.717414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.717896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.718648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:46:59.719077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:46:59.784693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:46:59.792449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bc8ca667-bae8-42b4-8b0c-3005c20e0372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.085462 Jun 24 08:46:59.793006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 159/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:46:59 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:00.233092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:00.233640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:00.239694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.240118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.240881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.241313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.378461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.386762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b1b93818-7bfe-421a-8c35-b9df775685cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.157591 Jun 24 08:47:00.387931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 153/312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:00.417188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:00.417927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:00.424596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.425043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.425844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.426282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.562924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.570343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ace3ef0b-d639-4e8f-90db-dbb72771b56d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.157483 Jun 24 08:47:00.571416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 160/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:00 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:00.817150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:00.817864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:00.824145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.824597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.825366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:00.825844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:00.892066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:00.899553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4d58b58e-7f0d-49dd-9b76-0986d1b2f634 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.089466 Jun 24 08:47:00.900120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 154/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:00 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:01.412246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:01.412844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.419524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.420119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.420990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.421426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.554057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:01.561811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-da9b9919-2f64-42ca-8817-ac779b29bb81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.153313 Jun 24 08:47:01.562383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 161/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:01.588742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:01.589419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.595443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.595890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.596866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.597306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.731295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:01.739043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f640f325-4dc0-4f0d-a62c-a8521851ba27 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.154913 Jun 24 08:47:01.739831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:01 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:01.917092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:01.917727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:01.924149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.924589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.925365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:01.925824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:01.995696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.004533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b5a3b728-632e-4ee4-8950-62a6a85f57b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.091822 Jun 24 08:47:02.005113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 162/317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:01 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:02.579648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:02.580252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:02.586388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.586842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.587605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.588036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.759815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:02.760694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:02.768518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.768976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.769840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:02.770294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:02.909027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.917496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d2e2f6dc-87d5-4fbc-8226-f0fd448d2ccd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.341674 Jun 24 08:47:02.918113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 156/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:02.940345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:02.947980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c0b1d818-a426-4ca9-b2ab-58836eca27c1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.194627 Jun 24 08:47:02.948546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 163/319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:02 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:03.022822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:03.024394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:03.030941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.031388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.032163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.032595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.101924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:03.109676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd505f9e-84d1-4ddd-90fa-3a839266a393 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.090872 Jun 24 08:47:03.110269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:03 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:03.935761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:03.936352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:03.942919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.943361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.944134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.944578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.964957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:03.965567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:03.972216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.972664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:03.973446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:03.973925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.173768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.178403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.182251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cfc7b254-529f-4ac0-936b-60a0fe4aac68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.250429 Jun 24 08:47:04.183126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 164/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:04.187008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5926d52a-fa7f-40f9-a114-1d2f9f3a667b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.225650 Jun 24 08:47:04.189756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 158/322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:03 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:04.196542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:04.197148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:04.203806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.204415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.205437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:04.205801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:04.208860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:04.274854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:04.283005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6f19e9db-3332-4e0f-9105-190848e474ed tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.090037 Jun 24 08:47:04.283880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 165/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:04 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:05.202956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.203894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.204403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.204522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.212704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.213160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.213975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.214439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.215380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.216200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.217691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.218516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.412154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.414889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.420112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f9af538-fc6d-4e3f-977e-ff67575f48a1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.219959 Jun 24 08:47:05.420688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 166/324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:05.422543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ea811b7e-4f0f-4e07-b2fb-04f4c0d65b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.226169 Jun 24 08:47:05.423247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 159/325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:05.425513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:05.426124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:05.431932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.432381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.433169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:05.433607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:05.493528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:05.500784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53870994-f2a3-4ae4-b65b-9d0cf7b72b01 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.079157 Jun 24 08:47:05.501345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 167/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:05 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:06.436717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:06.437396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:06.438915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:06.439529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:06.444200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.444660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.445576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.446085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.448876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.449325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.450216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.452326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.644636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:06.648390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:06.652695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-681335af-0b34-4580-991d-9f180b261d7a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.219985 Jun 24 08:47:06.653261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 160/327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:06 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:06.656155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2f4bd92f-63b2-4671-a3dc-5ec9db34ad0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.220945 Jun 24 08:47:06.656703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 168/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:06.657725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:06.658503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:06.664653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.665089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.665880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:06.666387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:06.726983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:06.734462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-08f01d89-73f1-4fee-b012-d31ac87f82fb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.080208 Jun 24 08:47:06.735023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 161/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:06 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:07.670557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.671204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.673061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.673691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.679932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.680733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.680964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.681297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.681875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.682096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.682527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.682668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.922533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.922678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:07.926751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-732f53b1-6d81-424c-a0ac-06c03b033f8b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.260435 Jun 24 08:47:07.927325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 169/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:07.931090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aa2c85da-1aca-4081-8b87-4dd547cb47b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.262150 Jun 24 08:47:07.932119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 162/331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:07.933254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:07.933904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:07.939949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.940401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:07.941170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:07.941601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.003818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:08.011885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba43dedb-c988-4338-a519-ee4c66ec79df tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.082258 Jun 24 08:47:08.012441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 170/332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:07 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:08.947457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:08.948182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:08.950012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:08.950819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:08.954493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.955099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.955868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.956466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.958315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.958768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:08.960198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:08.960591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.152993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:09.157406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:09.161740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ed414b3-c788-4e34-b9e3-3fe3a7d9d7c0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.218689 Jun 24 08:47:09.162318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 163/333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:08 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:09.165580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6dfe1078-9241-458e-a86a-15a01d916a68 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.220569 Jun 24 08:47:09.166166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 171/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:09.166875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:09.167591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:09.173704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.174156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.174918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:09.175345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:09.235840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:09.243726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c9a26d26-f83f-4346-a513-8aee2fdbe62e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.080460 Jun 24 08:47:09.244294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 164/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:09 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:10.178921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:10.179465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:10.181696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:10.182309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:10.186100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.186554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.187332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.187776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.188420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.188863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.189621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.190076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.384145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.388477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.391622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d7c071ea-9c7b-44f0-ab23-6e214e5f4eec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.213880 Jun 24 08:47:10.392405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 165/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:10.396752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:10.398251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:10.399914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01c7aef6-6006-4e7b-9e5b-e5a51dc3e180 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.224947 Jun 24 08:47:10.407782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 172/337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:10 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:10.408026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.408026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.408026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:10.408026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:10.470375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:10.477618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-982d70bc-40c0-4860-8f66-ea1767e02601 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.084398 Jun 24 08:47:10.478209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 166/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:10 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:11.408862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:11.409461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:11.416679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.416929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:11.417340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.417541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:11.417903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.418333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.423931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.424311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.425088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.425519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.430129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:11.617763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.620823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.627986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-553aa0b8-9288-4360-b123-eb20fd65dcee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.222857 Jun 24 08:47:11.630436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 173/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:11.635115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-42765b2a-3a7f-49d9-99a1-39cc9ceab7e9 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.222736 Jun 24 08:47:11.635982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:11.637107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:11.642281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 167/340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:11 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:11.645215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.645690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.646477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:11.647578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:11.709898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:11.717376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-620ba6c6-ed27-4e49-b6ea-d7f01d0ee85b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1249 microversion: 2.1 time: 0.085649 Jun 24 08:47:11.718159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 174/341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:11 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:12.654239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:12.655128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:12.655690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:12.657203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:12.671274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.672008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.672583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.673398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.674077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.675057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:12.675916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:12.676363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.025907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.039695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.040429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ddea91fe-971c-4032-91f9-5c3153cb8d99 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.387312 Jun 24 08:47:13.042549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 168/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:12 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:13.048829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:13.049500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:13.056444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.057146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.058114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.058820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.077431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-03714436-befc-463f-93d4-7a0f6defcee5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.426867 Jun 24 08:47:13.078049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 175/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:13.093637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-02ac9d79-f66d-422a-ac70-14d5931816ce req-5b88d196-896c-4d55-9829-792286ee9f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e8daec-3daf-46b1-9acf-12ad855cce98", "tag": "3d074919-a659-4eeb-9854-cca0cfcd1c21"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:13.106574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-02ac9d79-f66d-422a-ac70-14d5931816ce req-5b88d196-896c-4d55-9829-792286ee9f33 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.107085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-02ac9d79-f66d-422a-ac70-14d5931816ce req-5b88d196-896c-4d55-9829-792286ee9f33 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.119890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-02ac9d79-f66d-422a-ac70-14d5931816ce req-5b88d196-896c-4d55-9829-792286ee9f33 service nova] Creating event network-changed:3d074919-a659-4eeb-9854-cca0cfcd1c21 for instance 07e8daec-3daf-46b1-9acf-12ad855cce98 on hv-cinder-78729 Jun 24 08:47:13.124994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-02ac9d79-f66d-422a-ac70-14d5931816ce req-5b88d196-896c-4d55-9829-792286ee9f33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038275 Jun 24 08:47:13.125593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 176/344] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:13.133633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-c48a2c5d-01d0-4f72-9ce5-c1142c2a52be req-2e7456d0-1d76-40e5-9445-27ae4886d43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:13.143649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c48a2c5d-01d0-4f72-9ce5-c1142c2a52be req-2e7456d0-1d76-40e5-9445-27ae4886d43a service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:13.144325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c48a2c5d-01d0-4f72-9ce5-c1142c2a52be req-2e7456d0-1d76-40e5-9445-27ae4886d43a service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:13.158882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-c48a2c5d-01d0-4f72-9ce5-c1142c2a52be req-2e7456d0-1d76-40e5-9445-27ae4886d43a service nova] Creating event network-changed:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:47:13.165761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-c48a2c5d-01d0-4f72-9ce5-c1142c2a52be req-2e7456d0-1d76-40e5-9445-27ae4886d43a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038300 Jun 24 08:47:13.166993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 177/345] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:13.170027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:13.178687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-08134c6a-727a-41d2-b53c-2b9eaa1393ef tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1241 microversion: 2.1 time: 0.134572 Jun 24 08:47:13.179597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 169/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:13 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:14.060794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:14.061523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:14.069157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.070003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.071437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.071879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.102857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:14.104674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:14.113476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.123640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.124623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.125079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.280558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.288557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d97b7fbe-1f2f-422a-a1e2-2529919cd82b tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.233126 Jun 24 08:47:14.289140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 178/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:14 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:14.294198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:14.294808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:14.300679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.301124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.301914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:14.302346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:14.309847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.317142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6de6b8a8-ff04-45de-8f85-3121c0fe8bc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.220233 Jun 24 08:47:14.317719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 170/348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:14.367411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:14.374808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d7276d6f-f1e8-4cdd-bf82-3bf1357ae372 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.084721 Jun 24 08:47:14.375363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 179/349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:14 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:15.305858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:15.306466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:15.312424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.312866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.313625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.314083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.332859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:15.333480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:15.335921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=82 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:15.340856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.341306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.342093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.342521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.498074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:15.505350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1eef1b6e-1652-4446-8030-f7839e878e03 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.203850 Jun 24 08:47:15.506618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 171/350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:15 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:15.512145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:15.515788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:15.516373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:15.522165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.522614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.523333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9957b954-082e-4a8d-aa0c-a3d51107193b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.194218 Jun 24 08:47:15.523454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:15.523790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:15.523896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 180/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:15.587334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:15.594727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9f56819a-e470-4212-b61e-321ac9c708a8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.087168 Jun 24 08:47:15.595281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 172/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:15 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:16.522818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:16.523423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:16.530804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.531244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.532005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.532439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.539931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:16.540595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:16.547501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.547942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.548702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.549121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.712489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.719961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-358269b7-d6de-4e0a-b417-cb10266a3de0 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.200997 Jun 24 08:47:16.729292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 181/353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:16 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:16.729292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:16.729292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:16.732101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.732546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.733631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:16.733776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:16.745018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.752524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-81f17365-d26a-4650-8789-7ef669a4703c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.216522 Jun 24 08:47:16.762832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 173/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:16.797558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:16.806023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ca77f23c-116d-4a5f-a167-788d1fccf2e5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.084511 Jun 24 08:47:16.806576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 182/355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:16 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:17.736911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:17.737555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:17.743757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.744205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.744976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.745411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.769052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:17.769759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:17.776746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.777188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.777978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.778404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.782472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:17.926253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.933837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d720bf93-c67c-4ca7-886f-20e8f28e9372 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.201273 Jun 24 08:47:17.934671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 174/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:17 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:17.940065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:17.940726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:17.947188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.947629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.948401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:17.948830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:17.954707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:17.962972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef82ff20-f532-4cad-a325-af84b574d05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.197669 Jun 24 08:47:17.963542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 183/357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:18.013488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:18.022347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c3d0720f-7e85-4b9c-9277-3ec954d2692e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.085803 Jun 24 08:47:18.022832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 175/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:17 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:18.951557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:18.952163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:18.959239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.959687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.960451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.960879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.979610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:18.980221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:18.986846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.987350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:18.988128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:18.988556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.160208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.167659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.168076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c2a6e3b5-c568-4e77-8ef4-1308189bd0d4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.220557 Jun 24 08:47:19.168917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 184/359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:18 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:19.173548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:19.174136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:19.175596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-15c7ca1e-15bb-4e6f-aef0-db40126a4fbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.199718 Jun 24 08:47:19.176239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 176/360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:19.180506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.180950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.181723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:19.182154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:19.242402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:19.249985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1169633f-8555-46e0-a820-1b631f84f004 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.080031 Jun 24 08:47:19.250554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 185/361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:19 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:20.188615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.189139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.192241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.193356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.196120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.196573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.197354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.197811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.200057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.200513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.201283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.201748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.541460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.546392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.559718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8a64eb44-8e1f-49fd-b485-17c79f8be0d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.371222 Jun 24 08:47:20.560643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 186/362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:20.565878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:20.566563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:20.569608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4daad3e2-8c86-44bc-aa7b-ddae5fb1dd2a tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.385119 Jun 24 08:47:20.570753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 177/363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:20.581122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.581918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.582705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:20.583605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:20.681655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:20.689535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6d241a54-049c-4282-9dd2-693bf6e7eada tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1303 microversion: 2.1 time: 0.127143 Jun 24 08:47:20.692493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 187/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:20 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:21.579099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.580123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.586167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.586780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.586956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.587400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.588246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.588593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.592899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.593351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.594144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.594580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.785355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.788763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.794198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b567e308-fff4-4458-97b9-f868bb18a8ee tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.219948 Jun 24 08:47:21.794775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 178/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:21.796764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de6d51b1-fe1d-4696-96b6-721cd16cce6d tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.215108 Jun 24 08:47:21.797475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 188/366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:21.799939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:21.800584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:21.806551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.807015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.807806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:21.808359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:21.948909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:21.956545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3f95c8fd-890c-45c3-998a-2a6696c10e94 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.160661 Jun 24 08:47:21.957111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 179/367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:21 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:22.816791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:22.818978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:22.819601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:22.834499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:22.843051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.843499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.844857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.845307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.847131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.847579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:22.848382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:22.849519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.313079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.316965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.326811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2049e452-b1ba-411e-96e9-9c71ce784597 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.515876 Jun 24 08:47:23.327411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 180/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:22 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:23.328758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a67480b3-a251-41a5-8e18-869b1def5c2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.520394 Jun 24 08:47:23.329515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 189/369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:23.338605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:23.338605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:23.340397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.340744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.342127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.342127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.344146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-6f3c28f0-6153-408d-8436-8108017213a4 req-16d7ffd7-a3b6-4c87-ac44-a2f9f1c9bb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e8daec-3daf-46b1-9acf-12ad855cce98", "name": "network-vif-plugged", "status": "completed", "tag": "3d074919-a659-4eeb-9854-cca0cfcd1c21"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:23.353049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6f3c28f0-6153-408d-8436-8108017213a4 req-16d7ffd7-a3b6-4c87-ac44-a2f9f1c9bb6f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:23.353401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6f3c28f0-6153-408d-8436-8108017213a4 req-16d7ffd7-a3b6-4c87-ac44-a2f9f1c9bb6f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:23.365398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-6f3c28f0-6153-408d-8436-8108017213a4 req-16d7ffd7-a3b6-4c87-ac44-a2f9f1c9bb6f service nova] Creating event network-vif-plugged:3d074919-a659-4eeb-9854-cca0cfcd1c21 for instance 07e8daec-3daf-46b1-9acf-12ad855cce98 on hv-cinder-78729 Jun 24 08:47:23.371185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-6f3c28f0-6153-408d-8436-8108017213a4 req-16d7ffd7-a3b6-4c87-ac44-a2f9f1c9bb6f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030889 Jun 24 08:47:23.371787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 190/370] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:23.479571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:23.487102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1149c5ef-eabe-400c-80a5-91de7ad5d70b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.158635 Jun 24 08:47:23.487674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 181/371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:23 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:24.345274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.345992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.346363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.346479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.352282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.352560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.352773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.353012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.353553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.353816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.354002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.354257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.555563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.569335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.570471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-73276a3a-0467-43c4-b1d6-c86cdecde711 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.228639 Jun 24 08:47:24.571792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 182/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:24.578491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:24.579090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60596b79-ccf4-43b2-ba04-13fd0162ad32 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.238270 Jun 24 08:47:24.579327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:24.579874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 191/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:24.589730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.590480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.591878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:24.592703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:24.742004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:24.744342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:24.751285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-27e9b52c-92ad-4478-a350-3d7aefc28c89 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.177701 Jun 24 08:47:24.751621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 183/374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:24 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:25.223675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1603385620", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1024103265", "security_groups": [{"name": "tempest-secgroup-smoke-1206713253"}], "networks": [{"uuid": "8f69ae25-8c7d-47e5-ab33-9408a1584f0b"}], "block_device_mapping_v2": [{"uuid": "6fb8c364-ee3f-4ccf-ae3e-703c9a6f47ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:25.352312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] validate_networks() for [('8f69ae25-8c7d-47e5-ab33-9408a1584f0b', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:47:25.589157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:25.589960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:25.596322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.596780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.597547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.598004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.844464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:47:25.845274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:47:25.846306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:47:25.846935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:47:25.847565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:47:25.859100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.859902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.861094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.861756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.872837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:25.884224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d47ae949-08a0-4462-b202-8776fb25eb1c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.299325 Jun 24 08:47:25.890489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Getting quotas for project 315d35baa7c248a99083fc857a7e09e6. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:47:25.894520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 184/375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:25.896390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Getting quotas for user ca8b46b6c10644dcb5891acd98f1e5fb and project 315d35baa7c248a99083fc857a7e09e6. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:47:25.901883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:25.902735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:25.909784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.910469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.912046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:25.912651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:25.966372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:47:25.974944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6fb8c364-ee3f-4ccf-ae3e-703c9a6f47ed',volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:47:26.137182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71281e86-7c0e-412e-9c17-a4b74f20d21e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.919561 Jun 24 08:47:26.144066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 192/376] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:47:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:47:26.150910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:26.151694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:26.159707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.160321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.161629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.162875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.177851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.187114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-77f09de0-fdc6-4e4c-872a-eb39f1611fbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.290319 Jun 24 08:47:26.187956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 185/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:25 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:26.193916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-209fee86-cd61-41d2-815d-1248f276f565 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:26.194775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-209fee86-cd61-41d2-815d-1248f276f565 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:26.272196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-209fee86-cd61-41d2-815d-1248f276f565 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.279423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-209fee86-cd61-41d2-815d-1248f276f565 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1089 microversion: 2.1 time: 0.089985 Jun 24 08:47:26.289063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 186/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1089 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:26.375452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:26.383397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fb6e4d91-7525-4b5f-9fe1-7bed707c4a6e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.238068 Jun 24 08:47:26.392494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 193/379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:26 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:26.700892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-d301e0ee-d347-4858-afa1-412bfa148123 req-62118a92-5558-4735-861a-c0c9d0b6f3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4082e89e-1b7b-4b79-a6aa-73dd4baafb6f", "tag": "3926db83-00b6-4e73-a40a-6bae494be87c"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:26.706332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=80 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:26.712225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d301e0ee-d347-4858-afa1-412bfa148123 req-62118a92-5558-4735-861a-c0c9d0b6f3c6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.712759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d301e0ee-d347-4858-afa1-412bfa148123 req-62118a92-5558-4735-861a-c0c9d0b6f3c6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.726559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-d301e0ee-d347-4858-afa1-412bfa148123 req-62118a92-5558-4735-861a-c0c9d0b6f3c6 service nova] Creating event network-changed:3926db83-00b6-4e73-a40a-6bae494be87c for instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f on hv-cinder-78729 Jun 24 08:47:26.732139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-d301e0ee-d347-4858-afa1-412bfa148123 req-62118a92-5558-4735-861a-c0c9d0b6f3c6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035561 Jun 24 08:47:26.732912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 187/380] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:26.901322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:26.901965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:26.908226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.908669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:26.909426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:26.909894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.040056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.047847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86f1dbe5-57e8-4322-8b9c-9a41cc8ee859 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.150363 Jun 24 08:47:27.049785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 194/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:27.205026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:27.205634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:27.211901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.212356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.213118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.213554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.296863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:27.297488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:27.303594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.304042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.304809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.305276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.379161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.380982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.388646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-328a110a-3be2-41c7-8e10-9b6d1cf2cc3f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.187907 Jun 24 08:47:27.389698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2bd2601d-a366-4d35-91bc-04ef333ce4b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1139 microversion: 2.1 time: 0.096789 Jun 24 08:47:27.390011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 188/382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:27 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:27.390112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 195/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1139 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:27.400350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:27.400965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:27.407096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.407544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.408321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:27.408793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:27.540915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:27.548555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3448702e-1eff-4b3c-b962-8fa35698c668 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.152046 Jun 24 08:47:27.549117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 189/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:27 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:28.065230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.065897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.071918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.072359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.073123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.073548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.212650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:28.220624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-26bf8997-ba63-4e90-9ab2-52bc3b9a2aa5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.159141 Jun 24 08:47:28.221286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 196/385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:28.406795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.407441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.409955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.411118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.414263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.414714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.415489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.415920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.417297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.418039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.418815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.419253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.504541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:28.512654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ee6ce886-dc12-4ef8-ba1b-9bb8ae3e733e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1139 microversion: 2.1 time: 0.106746 Jun 24 08:47:28.513364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 197/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1139 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:28.565027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:28.565630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:28.571759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.572205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.572432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:28.572974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:28.573402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:28.580241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-67c08063-28d3-47d7-80c8-76ac04d52ed1 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.177261 Jun 24 08:47:28.581053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 190/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:28.708160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:28.715782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-64095f12-ad30-4544-baaf-c722f7711484 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.154558 Jun 24 08:47:28.716470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 198/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:28 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:29.237518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:29.238146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:29.244120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.244560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.245313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.245771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.380046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.389829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b8ea383d-610a-40c5-9cc6-342c0d8a9247 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.156023 Jun 24 08:47:29.390419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 191/389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:29.528869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:29.530141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:29.537165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.537619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.538429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.538877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.596590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:29.597307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:29.603645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.604171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.605052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.605482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.611001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.619358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0fe873e2-5d63-422a-9ac5-773076e9bb39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1139 microversion: 2.1 time: 0.094469 Jun 24 08:47:29.620226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 199/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1139 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:29.735527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:29.736134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:29.741791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.743047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.743625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.744394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:29.744819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:29.749289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5a2bce9d-eb5e-4af7-82de-decb83dc8bc2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.156540 Jun 24 08:47:29.750216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 192/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:29 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:29.874875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:29.883213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a7cde10f-bee6-4931-9937-67e8a93014cf tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.151504 Jun 24 08:47:29.883779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 200/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:29 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:30.407768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.408378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.415031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.415478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.416241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.416677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.546958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.554540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-27be7faa-a5ac-441b-a3cc-d0ab483a2993 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.150628 Jun 24 08:47:30.555110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 193/393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:30.636116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.636748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.643232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.643670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.644417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.645449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.648095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:30.706186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.714159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4eb0991d-98be-447c-b9a0-5361ea294f1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1139 microversion: 2.1 time: 0.081858 Jun 24 08:47:30.714726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 201/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:30.766889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.767529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.774518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.774968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.775749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.776217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.900136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:30.900774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:30.906846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.907247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.908023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:30.908459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:30.909177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:30.916673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5426012f-71dc-4411-8842-e0292cbcf85c tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.153632 Jun 24 08:47:30.917221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 194/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:31.037991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:31.045615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79d5722f-eee0-46d7-a918-d572d2ba257c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.149417 Jun 24 08:47:31.046204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 202/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:30 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:31.572732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:31.573338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:31.579556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.580065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.580799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.581235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.717510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:31.725214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-de23e810-06f8-4e89-b905-2176ee492da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.156380 Jun 24 08:47:31.725798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 195/397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:31.730793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:31.731536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:31.738220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.739171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.739933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.740360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.800078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:31.808030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e368beaa-2317-46f3-aeda-098f870de9fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1131 microversion: 2.1 time: 0.081103 Jun 24 08:47:31.808584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 203/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1131 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:31.934530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:31.935078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:31.942135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.942595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:31.943384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:31.943818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.063328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:32.063581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:32.071563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.072076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.072811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.073248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.080233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.088097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e7ca56a7-9870-4ff7-888e-db0f966bc28f tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.157743 Jun 24 08:47:32.088751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 196/399] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:31 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:32.200871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.208366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4f02cf10-6aac-4cb1-90e6-4344ea543144 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.149287 Jun 24 08:47:32.209012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 204/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:32 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:32.742386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:32.742918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:32.748851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.749293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.750076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.750503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.825712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:32.826312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:32.832918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.833362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.834155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:32.834587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:32.889519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.896999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7b8beae9-e654-4589-ac20-a32bc720c263 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.159073 Jun 24 08:47:32.897649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 197/401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:32.905414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:32.914136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c2455397-b483-4b42-8edf-56981a6b9b06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1131 microversion: 2.1 time: 0.092290 Jun 24 08:47:32.914703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 205/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1131 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:33.105061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.105751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.111871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.112307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.113065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.114166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.227756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.228373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.234912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.235365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.236144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.236628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.256418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.263880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-73ebc0ce-3733-4df1-a133-7a9fbf1735b4 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.162672 Jun 24 08:47:33.264467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 198/403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:33.371470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:33.379139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2c85f006-84d0-47ed-aa66-61186e9aaa95 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.157770 Jun 24 08:47:33.379807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 206/404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:33.914583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.915551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.923057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.923501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.924263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.924690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.931118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:33.931804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:33.938222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.938759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:33.939585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:33.940043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.020498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.028491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4a92f509-688c-4511-aa61-97e49320715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1187 microversion: 2.1 time: 0.101171 Jun 24 08:47:34.029257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 207/405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:34.081690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.089367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-debe57d5-917f-499d-978b-103ed66c98f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.178755 Jun 24 08:47:34.089994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 199/406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:34.281718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:34.282321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:34.288579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.289198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.289999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.290430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.396036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:34.397458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:34.405890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.409851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.413331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.416167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.485908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.496662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d82cd6c-3519-42cd-8ea4-adb0b9a2a664 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1314 microversion: 2.1 time: 0.218687 Jun 24 08:47:34.507427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 208/407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:34 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:34.592164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-94efbf44-4030-4d49-98cc-49ccaa1b904d req-08fcc660-47ef-4b9a-a907-a73ec3573dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "name": "network-vif-plugged", "status": "completed", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:34.601930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-94efbf44-4030-4d49-98cc-49ccaa1b904d req-08fcc660-47ef-4b9a-a907-a73ec3573dc8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:34.602510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-94efbf44-4030-4d49-98cc-49ccaa1b904d req-08fcc660-47ef-4b9a-a907-a73ec3573dc8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:34.618275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:34.623730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-94efbf44-4030-4d49-98cc-49ccaa1b904d req-08fcc660-47ef-4b9a-a907-a73ec3573dc8 service nova] Creating event network-vif-plugged:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:47:34.626746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f6311f01-18c5-4935-9d3c-1819df6ff71e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.234876 Jun 24 08:47:34.628055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 200/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:34 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:34.629745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-94efbf44-4030-4d49-98cc-49ccaa1b904d req-08fcc660-47ef-4b9a-a907-a73ec3573dc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041333 Jun 24 08:47:34.630562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 209/409] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:35.049294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.050063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.057169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.058460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.059324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.059770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.107792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.108484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.120463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.120972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.122023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.122529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.166371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:35.176615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-484b76da-2318-437c-9430-d2ee7105ae95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1195 microversion: 2.1 time: 0.130513 Jun 24 08:47:35.178127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 201/410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:35.371707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:35.388043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-805ae485-fb4b-4b4b-bd0a-e52c7babaafc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.282042 Jun 24 08:47:35.390800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 210/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:35.514242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.514855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.521484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.521975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.522757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.523213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.526018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:35.645173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.645652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.651895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.652341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.653133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.653548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.675751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:35.683732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a2360af4-626a-4418-ace4-8e76c55c6355 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1463 microversion: 2.1 time: 0.173249 Jun 24 08:47:35.684692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 202/412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:35.734806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.735463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.742230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.742708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.743469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.743902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.770795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:47:35.797191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:35.805551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b55a1052-3df0-47ad-afc6-81368137675d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.165014 Jun 24 08:47:35.806335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 211/413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:35.866800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-95e9fe3c-447f-4ff6-9e8d-68a2719b5410 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "DELETE /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 204 len: 0 microversion: 2.1 time: 0.135711 Jun 24 08:47:35.867377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 203/414] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:47:35 2022] DELETE /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:47:35.875613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:35.876269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:35.878311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:35.885076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.885524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.886340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:35.886817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:35.906768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:36.109539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.119321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-875a787f-971c-4422-bfbf-b2326952736e tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.247521 Jun 24 08:47:36.120224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:35 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:36.195548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:36.196242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:36.202421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.202869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.203641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.204071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.268451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.276078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:36.278591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6b8b7e72-bfeb-410c-8f38-087fcce74401 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1205 microversion: 2.1 time: 0.087486 Jun 24 08:47:36.279363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 204/416] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1205 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:36.406341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:36.406950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:36.413620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.414786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.414922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.415281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.582731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.590499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ef85159-d925-4aee-911f-c4217402479d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.188046 Jun 24 08:47:36.591091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 213/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:36.824000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:36.824640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:36.831120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.831605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.832914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:36.833346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:36.979324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:36.988520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-327b0534-c1b7-4978-a777-5f5dfbd5617c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.167779 Jun 24 08:47:36.989170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 205/418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:36 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:37.137203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:37.137829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:37.144295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.144737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.145492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.145977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.285582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.293840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7dac97ce-dc9d-4cc7-b0a2-dc12b9ec1478 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.160401 Jun 24 08:47:37.294402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:37 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:37.301596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:37.302341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:37.308860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.309304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.310103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.310529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.448861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.456377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1f6915b4-1e5d-40f3-8dc6-a19fe601aff5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1273 microversion: 2.1 time: 0.163577 Jun 24 08:47:37.456948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 206/420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:37.607897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:37.608632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:37.615714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.616236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.617063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:37.617555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:37.750294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:37.757760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de331614-78a9-4110-a94e-04532b94b472 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.153619 Jun 24 08:47:37.758282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 215/421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:38.005359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.006024 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.012140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.012593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.013359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.013831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.219085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.231982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7c40842a-9f53-43cf-9226-ebf510e1262d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.230285 Jun 24 08:47:38.232647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 207/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:38.311136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.311924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.319959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.320402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.321166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.321591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.472413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.473032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.482463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.484168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.484860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.485699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.486412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.495062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9b7bb0d4-0023-44e8-b8e9-dd17030eb2d7 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.187820 Jun 24 08:47:38.506114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 216/423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:38.735541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.760472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-61f8a500-8a9f-4ee5-83c2-d1c02033894f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1273 microversion: 2.1 time: 0.291814 Jun 24 08:47:38.763002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 208/424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:38.775507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:38.776391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:38.787491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.789390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.790387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.791034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.821673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-4a3a514f-8be3-4e89-895d-8fc16d9e4e4c req-cccce479-884e-4aef-81dc-37bdb87c2bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:38.854009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-4a3a514f-8be3-4e89-895d-8fc16d9e4e4c req-cccce479-884e-4aef-81dc-37bdb87c2bf0 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:38.858358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-4a3a514f-8be3-4e89-895d-8fc16d9e4e4c req-cccce479-884e-4aef-81dc-37bdb87c2bf0 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:38.872582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-4a3a514f-8be3-4e89-895d-8fc16d9e4e4c req-cccce479-884e-4aef-81dc-37bdb87c2bf0 service nova] Creating event network-changed:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 08:47:38.880014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-4a3a514f-8be3-4e89-895d-8fc16d9e4e4c req-cccce479-884e-4aef-81dc-37bdb87c2bf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062086 Jun 24 08:47:38.882101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 209/425] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:38.975118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:38.985179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b3dc4a39-2115-42bd-aca9-f0a4ae89d521 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.213981 Jun 24 08:47:38.985958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:39.251460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:39.252523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:39.277620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.278339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.280531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.282362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.450119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.460978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-acfd84df-c3a6-4f8e-8f0a-6ac7c6f3960b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.216227 Jun 24 08:47:39.461687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 210/427] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:39.512917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:39.513484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:39.520920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.521369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.522188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.522622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.542277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:39.673279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.681155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5113b14-d029-471d-9a22-feb374c2f983 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.172298 Jun 24 08:47:39.681880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 218/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:39.776070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:39.776680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:39.782716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.783166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.783923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:39.784683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:39.919618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:39.927436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3584408b-7cb1-4a99-920f-cf0648faee10 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.155100 Jun 24 08:47:39.928007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:40.002281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.003056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.009548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.010033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.010795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.011233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.153370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:40.161846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6304b152-af6b-48a2-83d1-0a643d82163a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.163253 Jun 24 08:47:40.162582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 219/430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:40.479592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.480204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.486276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.486717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.487489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.487915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.699345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.700063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.707585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.708037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.708818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.709249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.720246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:40.729811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a88d89bf-c240-4566-8b9d-0a815378aa2c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.254621 Jun 24 08:47:40.730540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 212/431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:40 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:40.873131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:40.880754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3a502745-d6aa-43e3-925b-43d30fb02eed tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.185220 Jun 24 08:47:40.890692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 220/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:40 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:40.944458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:40.945381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:40.951628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.952273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:40.953228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:40.953850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.093761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.101682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-577118fd-708c-4328-9ffd-1302c0d72d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.161117 Jun 24 08:47:41.102226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 213/433] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:41.180786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:41.181396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:41.187765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.188314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.189232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.189689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.331743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.340133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79661de1-6632-4159-8ed8-6aedd44ab6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1357 microversion: 2.1 time: 0.163541 Jun 24 08:47:41.349802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 221/434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:41.747075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:41.747730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:41.753821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.754262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.755033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.755462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.890720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:41.899225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3c65eaca-8dd8-46f4-aea4-a94fde89bd4d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.155956 Jun 24 08:47:41.899974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 214/435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:41 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:41.903459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:41.904268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:41.906715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:41.913881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.914330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:41.915106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:41.915570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.048069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.056898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2eb6a445-0934-4cfa-a1f8-ad7d31ea2e62 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.161760 Jun 24 08:47:42.057465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 222/436] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:41 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:42.118792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.119392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.126000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.126445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.127195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.127629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.356475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.357122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.364233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.364978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.365976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.366582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.639237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.642886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.648606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f92a4921-ce4a-4bdf-a5d6-c8eef8cf0393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.533762 Jun 24 08:47:42.649841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 215/437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:42.656801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3958f7e6-a79f-4fb2-b97e-b7a7fa433abf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1546 microversion: 2.1 time: 0.304026 Jun 24 08:47:42.657759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 223/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1546 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:42.674453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.675596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.684045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-7ed20862-1d09-4f65-8d5f-70302ad63238 req-ef23249a-011c-4ed0-9c31-af307994f0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e8daec-3daf-46b1-9acf-12ad855cce98", "name": "network-vif-unplugged", "status": "completed", "tag": "3d074919-a659-4eeb-9854-cca0cfcd1c21"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:42.692649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.693097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.694154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.694581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.697550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-7ed20862-1d09-4f65-8d5f-70302ad63238 req-ef23249a-011c-4ed0-9c31-af307994f0c2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.698886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-7ed20862-1d09-4f65-8d5f-70302ad63238 req-ef23249a-011c-4ed0-9c31-af307994f0c2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.711884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-7ed20862-1d09-4f65-8d5f-70302ad63238 req-ef23249a-011c-4ed0-9c31-af307994f0c2 service nova] Creating event network-vif-unplugged:3d074919-a659-4eeb-9854-cca0cfcd1c21 for instance 07e8daec-3daf-46b1-9acf-12ad855cce98 on hv-cinder-78729 Jun 24 08:47:42.722075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-7ed20862-1d09-4f65-8d5f-70302ad63238 req-ef23249a-011c-4ed0-9c31-af307994f0c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041656 Jun 24 08:47:42.722956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 224/439] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:42.829557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.837391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1d0b8367-690b-4319-b1d7-2f10b15cc616 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1546 microversion: 2.1 time: 0.166736 Jun 24 08:47:42.838002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 216/440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:42.853630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.857104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:42.858170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Searching by: {'deleted': False, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c'} {{(pid=124404) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 08:47:42.865450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.865944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.866739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.867215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.919065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:42.919665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:42.926695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.927152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.927934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:42.928372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:42.959492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.multi_cell_list [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124404) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 08:47:43.065149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2ef79e7c-f12a-41c4-ba4c-400eae971003 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215441 Jun 24 08:47:43.065841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 225/441] 10.222.0.48 () {58 vars in 1124 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:43.079556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:43.080640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:43.088051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.088051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.088950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.089501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.208449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.216050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:43.241269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c80d075b-bf0e-48f2-9268-faeb3a379d1e tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.326094 Jun 24 08:47:43.249112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 217/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:42 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:43.249112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:43.249872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:43.256760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.257575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.258951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.259614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.384404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.393268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-78ea1443-97ba-4fbc-94af-9d3f4fdf3bbf tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1469 microversion: 2.1 time: 0.322494 Jun 24 08:47:43.404205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 226/443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:43 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:43.521029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:43.531237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-84ba7da6-5e0d-4fcf-a98d-836aed88f708 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1546 microversion: 2.1 time: 0.286828 Jun 24 08:47:43.532396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 218/444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1546 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:43.668791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:43.670416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:43.682800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.683282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.684034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:43.692591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:43.703588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-500406326", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "networks": [{"uuid": "07011d30-51b0-4828-bb1e-48b4741b1b8c"}]}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:43.794834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] validate_networks() for [('07011d30-51b0-4828-bb1e-48b4741b1b8c', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:47:44.150942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:44.160586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-340a73f6-fe59-448b-897e-1b8ba853aa7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.495935 Jun 24 08:47:44.171058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 227/445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:44.177007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-713840ef-f48e-4532-bf41-f952b845ba23 req-4eaafd96-c710-4d6c-8472-90c32659d504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e8daec-3daf-46b1-9acf-12ad855cce98", "name": "network-vif-deleted", "tag": "3d074919-a659-4eeb-9854-cca0cfcd1c21"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:44.185631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-713840ef-f48e-4532-bf41-f952b845ba23 req-4eaafd96-c710-4d6c-8472-90c32659d504 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.186119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-713840ef-f48e-4532-bf41-f952b845ba23 req-4eaafd96-c710-4d6c-8472-90c32659d504 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.202663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-713840ef-f48e-4532-bf41-f952b845ba23 req-4eaafd96-c710-4d6c-8472-90c32659d504 service nova] Creating event network-vif-deleted:3d074919-a659-4eeb-9854-cca0cfcd1c21 for instance 07e8daec-3daf-46b1-9acf-12ad855cce98 on hv-cinder-78729 Jun 24 08:47:44.209382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-713840ef-f48e-4532-bf41-f952b845ba23 req-4eaafd96-c710-4d6c-8472-90c32659d504 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036722 Jun 24 08:47:44.210181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 228/446] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:44.268904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:44.269853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:44.276195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.276640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.277421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.277889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.474759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:47:44.475555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:47:44.476186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:47:44.476740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:47:44.477288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:47:44.491386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.491839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.492648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.493086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.504990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:44.514880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32198eb0-1955-499c-bf1c-a76f4b7e50c8 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.250646 Jun 24 08:47:44.524877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Getting quotas for project 7e56778eb68e4cf3b1041ac4b23e3d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:47:44.527727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 229/447] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:44 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:44.529914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Getting quotas for user 215190af23614b10853fdff03dc3d8cb and project 7e56778eb68e4cf3b1041ac4b23e3d8d. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:47:44.533605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:44.534850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:44.545120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:47:44.548052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:47:44.555334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.555794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.556583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.557025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.615053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34ad71fa-b917-425d-81e4-56a9eff8dfc0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918729 Jun 24 08:47:44.617230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.617690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.618156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lazy-loading 'fault' on Instance uuid 07e8daec-3daf-46b1-9acf-12ad855cce98 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:47:44.624508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 219/448] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:47:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 08:47:44.636361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6cd0b114-87c4-4be0-9c01-97d240a093b5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:44.639216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6cd0b114-87c4-4be0-9c01-97d240a093b5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:44.702002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a1727db0ff34df791d23edd53e2590d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387d792bae064f11abdf2f66de730af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:44.713220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79a0bbbe-2226-4656-ad2d-88cc7b9ef8ba tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 200 len: 1304 microversion: 2.1 time: 0.183194 Jun 24 08:47:44.714418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 230/449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:44 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 1304 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:44.747617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6cd0b114-87c4-4be0-9c01-97d240a093b5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:44.755716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6cd0b114-87c4-4be0-9c01-97d240a093b5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1218 microversion: 2.1 time: 0.124378 Jun 24 08:47:44.757716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 220/450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:44 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:44.885580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-2741cf8e-f89f-4fd8-8e52-d9d51a4af02c req-cfbbb604-45b2-4e57-9d5e-4a1ad387c25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4082e89e-1b7b-4b79-a6aa-73dd4baafb6f", "name": "network-vif-plugged", "status": "completed", "tag": "3926db83-00b6-4e73-a40a-6bae494be87c"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:44.896245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-2741cf8e-f89f-4fd8-8e52-d9d51a4af02c req-cfbbb604-45b2-4e57-9d5e-4a1ad387c25b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:44.896696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-2741cf8e-f89f-4fd8-8e52-d9d51a4af02c req-cfbbb604-45b2-4e57-9d5e-4a1ad387c25b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:44.910621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-2741cf8e-f89f-4fd8-8e52-d9d51a4af02c req-cfbbb604-45b2-4e57-9d5e-4a1ad387c25b service nova] Creating event network-vif-plugged:3926db83-00b6-4e73-a40a-6bae494be87c for instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f on hv-cinder-78729 Jun 24 08:47:44.939245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-2741cf8e-f89f-4fd8-8e52-d9d51a4af02c req-cfbbb604-45b2-4e57-9d5e-4a1ad387c25b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057893 Jun 24 08:47:44.940115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 231/451] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:47:45.179437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:45.179956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:45.187387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.188056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.188987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.189593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.321128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.328545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f4f6041b-aeac-4253-918a-e852123e9eab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.154282 Jun 24 08:47:45.329114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 221/452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:45.536327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:45.537022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:45.543639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.544086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.544870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.545544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.691457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.700204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40ad3d46-d39d-400c-928f-92d500e7c682 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.169190 Jun 24 08:47:45.700949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 232/453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:45 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:45.731055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:45.731758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] [instance: 07e8daec-3daf-46b1-9acf-12ad855cce98] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:45.738225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.738678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.739466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.739899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.754222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] HTTP exception thrown: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Request method failure captured: Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 HTTP/1.1 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnf7u_b6JPemhzo4ROsnc_bTmzVx6Sg65RN_xggaR_eFh0CFhqhUXp5vBNyFDjdWGJ6sOMkTILpZu-c-qhd7vEbIRsWFlNFgZuzLe3jdGxNb58-ttMyrCjN3RCe9hDc7ca0SbgZfJeFcT4hyJjEjhQCaJ0B3NOc2kPZri1M3f8Xj_w Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 387d792bae064f11abdf2f66de730af0 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesNegativeTest-1229616375 Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:47:45.755878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/387d792bae064f11abdf2f66de730af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/387d792bae064f11abdf2f66de730af0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_387d792bae064f11abdf2f66de730af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/387d792bae064f11abdf2f66de730af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesNegativeTest-1229616375 Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 387d792bae064f11abdf2f66de730af0 Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesNegativeTest-1229616375 Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesNegativeTest-1229616375-project Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 1a1727db0ff34df791d23edd53e2590d Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesNegativeTest-1229616375-project Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. Jun 24 08:47:45.757628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '07e8daec-3daf-46b1-9acf-12ad855cce98'} Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:47:45.758549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. Jun 24 08:47:45.759979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:47:45.761268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] Returning 404 to user: Instance 07e8daec-3daf-46b1-9acf-12ad855cce98 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:47:45.761268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5437eb2b-0211-4da7-bc2b-e087a71bb5d2 tempest-VolumesNegativeTest-1229616375 tempest-VolumesNegativeTest-1229616375-project] 10.222.0.48 "GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98" status: 404 len: 111 microversion: 2.1 time: 0.030549 Jun 24 08:47:45.761268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 222/454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:45 2022] GET /compute/v2.1/servers/07e8daec-3daf-46b1-9acf-12ad855cce98 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 08:47:45.773973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:45.775423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:45.780951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.781402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.782598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:45.783043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:45.850563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:45.858863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-574e8ab9-f344-4d68-af91-f65d099c6d03 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1222 microversion: 2.1 time: 0.088915 Jun 24 08:47:45.859453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 233/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:45 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:46.345446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:46.346332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:46.356046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.356829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.358254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.359055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.427687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeee1da9-03b7-4c33-8cb4-9c94209e5305"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:46.429104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:46.435659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.436350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.437198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.437699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.533758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.542539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e08ce7f0-7fef-447a-966b-0b6245565bc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.201509 Jun 24 08:47:46.546559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 223/456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:46.728018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:46.730313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:46.739326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.740130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.740504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:46.740796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:46.938312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:46.958686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34319f8e-ad50-414b-a3ad-4d8f47ba77b7 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.244081 Jun 24 08:47:46.959646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 224/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:46 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:46.980804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:46.981429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:47.008926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.013218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.014164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.019847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.155845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:47.165477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3d40106e-6af3-4f26-b4a8-bd8f4f0683c0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1214 microversion: 2.1 time: 0.190274 Jun 24 08:47:47.165981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 225/458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:46 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:47.238788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cba21f69-6942-4576-a8e4-345c67be1764 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815422 Jun 24 08:47:47.239955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 234/459] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 08:47:46 2022] POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 194 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:47.560791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:47.561402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:47.563966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:47.571831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.572465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.573281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.574004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.733593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:47.741634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0e2aef8d-5551-49ee-a0d9-13b71cf332b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.185325 Jun 24 08:47:47.742309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 226/460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:47.985516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:47.986212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:47.994074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.994534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.995325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:47.995767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:47.998929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:48.178906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:48.186784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:48.187104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7c7c575a-ca0b-4e4e-968a-41d3ba8c2236 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.206876 Jun 24 08:47:48.187301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:48.187626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 235/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:47 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:48.194757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.195112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.195911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.196357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.275800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:48.285616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ec67b3e9-314a-44af-8a81-51a4d166b4c9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1270 microversion: 2.1 time: 0.102623 Jun 24 08:47:48.286338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 227/462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:48 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:48.759182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:48.759796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:48.767508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.768742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.769694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:48.770285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:48.960201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:48.967947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-446c2e5d-62dc-4d52-9fc1-8765d2b89f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.213212 Jun 24 08:47:48.968523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 236/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:49.215308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.217804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.229229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.229949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.230745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.231193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.305495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.312077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.328510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.330325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.332344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.333113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.440716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:49.453301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c318ab29-933d-40c3-bb8c-871f4d7ef7e0 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1276 microversion: 2.1 time: 0.151608 Jun 24 08:47:49.454236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 237/464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:49.490948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:49.499937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bbf37203-daf0-4b02-8ede-b7d61435a0bb tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1371 microversion: 2.1 time: 0.290363 Jun 24 08:47:49.500610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 228/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:49.985242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:49.986034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:49.993779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.994233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:49.995010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:49.995691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.153222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.162250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53f3689e-456a-4262-a816-9667049c02cb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.180615 Jun 24 08:47:50.162877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 238/466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:50.470744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:50.471347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.483401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.483401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.483401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.483401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.517567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:50.518225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.528167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.529433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.530286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.530716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.758616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.762594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:50.773275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-39a20c3c-b36d-4186-88ed-f0754567fb51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.306137 Jun 24 08:47:50.773514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3c184a48-b884-4825-bbc7-063e20eb77cd tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 200 len: 1565 microversion: 2.1 time: 0.259727 Jun 24 08:47:50.774192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 229/467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:50 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:50.779216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-ba220d63-8d6b-46dd-8486-39d9a76629ca req-7e3acbde-e5b8-47bb-93fa-3e3ba2b27675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed", "tag": "8ab0f10b-0afc-4dfa-8c24-26274083afe3"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:50.785969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 239/468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:50 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:50.788814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-ba220d63-8d6b-46dd-8486-39d9a76629ca req-7e3acbde-e5b8-47bb-93fa-3e3ba2b27675 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.789337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-ba220d63-8d6b-46dd-8486-39d9a76629ca req-7e3acbde-e5b8-47bb-93fa-3e3ba2b27675 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.791831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:50.792422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:50.803808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-ba220d63-8d6b-46dd-8486-39d9a76629ca req-7e3acbde-e5b8-47bb-93fa-3e3ba2b27675 service nova] Creating event network-changed:8ab0f10b-0afc-4dfa-8c24-26274083afe3 for instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed on hv-cinder-78729 Jun 24 08:47:50.809235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-ba220d63-8d6b-46dd-8486-39d9a76629ca req-7e3acbde-e5b8-47bb-93fa-3e3ba2b27675 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033422 Jun 24 08:47:50.809937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 230/469] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:50.811212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.811679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.812468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:50.812911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:50.900109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7d2eb4b9-dda2-436c-a88f-d61714c22b23 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112464 Jun 24 08:47:50.900707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 240/470] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 08:47:50 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:51.180769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:51.181482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:51.189226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.189690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.190709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.191384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.459367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:51.467838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0023caa-462d-41ce-9d0a-a8cc60e360f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.291284 Jun 24 08:47:51.468513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 231/471] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:51.792934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:51.794329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:51.803434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.804889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:51.806172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:51.806670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.247598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.255325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f71eff7e-1c21-4eea-bcd9-dcf8d63a084c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.466710 Jun 24 08:47:52.257756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 241/472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:51 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:52.351821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-6a5eb0f3-cb43-44d8-96d5-0ab8797082f4 req-82019ca8-ffc9-4088-a1ec-513194f2fecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4082e89e-1b7b-4b79-a6aa-73dd4baafb6f", "tag": "3926db83-00b6-4e73-a40a-6bae494be87c"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:47:52.362397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6a5eb0f3-cb43-44d8-96d5-0ab8797082f4 req-82019ca8-ffc9-4088-a1ec-513194f2fecb service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.362844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6a5eb0f3-cb43-44d8-96d5-0ab8797082f4 req-82019ca8-ffc9-4088-a1ec-513194f2fecb service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.377159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-6a5eb0f3-cb43-44d8-96d5-0ab8797082f4 req-82019ca8-ffc9-4088-a1ec-513194f2fecb service nova] Creating event network-changed:3926db83-00b6-4e73-a40a-6bae494be87c for instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f on hv-cinder-78729 Jun 24 08:47:52.383020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-6a5eb0f3-cb43-44d8-96d5-0ab8797082f4 req-82019ca8-ffc9-4088-a1ec-513194f2fecb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034890 Jun 24 08:47:52.386222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 232/473] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:47:52.494130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:52.494903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:52.502952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.503395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.504469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:52.504910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:52.660961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:52.676927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5ebea13c-c77d-468a-9803-02c7d3890f9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.188586 Jun 24 08:47:52.679294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 242/474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:53.273578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:53.274344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:53.282754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.283234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.284618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.285054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.431256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:53.439133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2273688b-1662-489d-8a13-986438f10847 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.169789 Jun 24 08:47:53.439728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 233/475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:53 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:53.695566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:53.696371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:53.698711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:53.704473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.704926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.706409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:53.706845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:53.843142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:53.851371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e420e205-b7f1-4ebc-9afa-ee0362941147 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.159633 Jun 24 08:47:53.851960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 243/476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:54.457555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:54.458557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:54.466863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.467311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.468100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.468544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.511614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:54.617150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:54.626602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-82e475d1-b063-4265-91b0-8bd456caa80b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.173809 Jun 24 08:47:54.627372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 234/477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:54 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:54.868695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:54.869310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:54.876242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.876691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:54.878185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:54.878625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.026968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.039636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dff69538-9331-45b1-86e4-93cdff411f25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.174568 Jun 24 08:47:55.040255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 244/478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:55.647671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:55.648266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:55.650181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=8 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:55.655574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.656017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.656779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:55.657206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:55.827812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:55.836068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-afb763c6-6cc3-4f76-9da9-f1aa5d49dad5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.192217 Jun 24 08:47:55.836648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 235/479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:55 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:56.058868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.059566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.067516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.067969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.068757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.069195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.220231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:56.228098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-338033ed-3a0c-4106-8e4d-cacc7316f794 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.173234 Jun 24 08:47:56.228743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 245/480] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:56.853014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:56.853626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:56.860043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.860465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:56.861834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:56.862277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.012223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.021195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bc0cc207-e69c-414f-8e96-b6de33965d7f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.171913 Jun 24 08:47:57.021973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 236/481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:56 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:57.245807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:57.246370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:57.253608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.254073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.254836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:57.255262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:57.393307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:57.401170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a93c49ba-07d1-43bf-b31d-c7c3eca421b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.159401 Jun 24 08:47:57.401782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 246/482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:58.039642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:58.040255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:58.046751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.047195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.047999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.048437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.193225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:58.201321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-97189125-7d48-4b3d-8e05-cf0c86d36920 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.165505 Jun 24 08:47:58.201933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 237/483] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:58 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:58.419068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:58.419681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:58.427127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.427580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.428365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:58.428789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:58.568823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:58.577111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b28d76eb-3ded-4f2e-ae89-7d0e109f9c39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.162036 Jun 24 08:47:58.577865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 247/484] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:47:59.219232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:59.219843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:59.226516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.226959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.227712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.228142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.230693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:59.364913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.372282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2a74f1b6-69da-4fd4-bb6a-4b70e3381bb9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.156920 Jun 24 08:47:59.372837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 238/485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:59 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:47:59.596231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:47:59.596829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:47:59.603492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.603711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.604464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:47:59.604896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:47:59.733300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:47:59.740882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d66560ee-e0ae-406b-a238-845abb2a42e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.148455 Jun 24 08:47:59.741458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 248/486] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:47:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:00.388241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:00.388861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.395006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.395450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.396253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.396681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.538453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.546266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bba127bf-6113-4eda-ad66-dd914533643d tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.161790 Jun 24 08:48:00.546847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 239/487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:00 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:00.758279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:00.758988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:00.765616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.766095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.766866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:00.767297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:00.904088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:00.912213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f91f7803-a46f-4cf8-af7b-dd396f87a617 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.158766 Jun 24 08:48:00.912790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 249/488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:01.564454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.565300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:01.575798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.576526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.577472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.578144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.730617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:01.738399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f07ac74c-6b2e-402e-a9c1-3eb7ede9dda8 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.177793 Jun 24 08:48:01.739420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 240/489] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:01 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:01.930319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:01.931398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:01.939138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.939923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:01.941475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:01.942063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:02.078657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.086115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ba729a7-bb72-4f62-ac08-5ad01bf20243 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.160034 Jun 24 08:48:02.086683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 250/490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:02.755314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:02.755833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:02.761759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:02.762203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:02.762961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:02.763390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:02.893263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:02.901470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f2deba7b-976e-4ade-a3ff-98006e426a82 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.150011 Jun 24 08:48:02.902080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 241/491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:02 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:03.104579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:03.105374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:03.112064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.112505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:03.113262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.113717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:03.248395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:03.256463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-975517ac-8a00-4d7c-8b86-94afe2c759e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.156202 Jun 24 08:48:03.257031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 251/492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:03.918683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:03.919229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:03.925351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.925831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:03.926602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:03.927037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.065022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.073245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-153557ab-8ce3-4e70-970d-a39abc1cceee tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.158731 Jun 24 08:48:04.073864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 242/493] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:03 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:04.272912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:04.273512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:04.280078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.280518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.281372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:04.281811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:04.285586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:04.409578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:04.417198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b8d5efce-bc56-4ec0-9299-401541c13454 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.148715 Jun 24 08:48:04.417773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 252/494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:05.089899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:05.090506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:05.097439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.099176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.099969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.100407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.236764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.244389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78db98d8-0c1d-4134-9d6a-0e14c0020891 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.158315 Jun 24 08:48:05.244970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 243/495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:05 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:05.433039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:05.433698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:05.440410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.440838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.441604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:05.442607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:05.577518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:05.585847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0338ffec-5d66-4459-abef-b6fbe805c8af tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.156569 Jun 24 08:48:05.586635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 253/496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:06.263085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:06.263656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:06.269899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.270347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.271130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.271557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.431509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:06.440203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1d0716dc-f6bf-4a40-afb0-fde8b8be4714 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.182458 Jun 24 08:48:06.440998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 244/497] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:06 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:06.603637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:06.604247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:06.611007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.611456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.612224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:06.612654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:06.747831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:06.755183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bd9c3c3d-4c2c-4308-8468-ebdd088c8f4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.155778 Jun 24 08:48:06.755746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 254/498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:07.127797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-5ff28f27-c873-468d-a5f4-a4534ce72104 req-28b7e1e2-edeb-43f2-962d-2b5fcfc88a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed", "name": "network-vif-plugged", "status": "completed", "tag": "8ab0f10b-0afc-4dfa-8c24-26274083afe3"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:07.136684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-5ff28f27-c873-468d-a5f4-a4534ce72104 req-28b7e1e2-edeb-43f2-962d-2b5fcfc88a87 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.137165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-5ff28f27-c873-468d-a5f4-a4534ce72104 req-28b7e1e2-edeb-43f2-962d-2b5fcfc88a87 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.150967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-5ff28f27-c873-468d-a5f4-a4534ce72104 req-28b7e1e2-edeb-43f2-962d-2b5fcfc88a87 service nova] Creating event network-vif-plugged:8ab0f10b-0afc-4dfa-8c24-26274083afe3 for instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed on hv-cinder-78729 Jun 24 08:48:07.156724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-5ff28f27-c873-468d-a5f4-a4534ce72104 req-28b7e1e2-edeb-43f2-962d-2b5fcfc88a87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032708 Jun 24 08:48:07.157601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 245/499] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:07.457130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:07.457777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:07.464242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.464766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.465566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.466029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.625438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.633926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-89df8e79-f5d4-4559-8f24-97bf2edbed15 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.180680 Jun 24 08:48:07.634511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 255/500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:07 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:07.772670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:07.773365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:07.779633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.780084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.780839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:07.781269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:07.912603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:07.920294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cd88954e-2e50-4250-9ea3-82215b889986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.151881 Jun 24 08:48:07.920860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 246/501] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:08.655050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:08.655645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:08.662557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.663016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.663802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.664238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.887244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:08.911263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-245700bb-7038-4c4c-82ec-fb9f11ab37d1 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.259531 Jun 24 08:48:08.912284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 256/502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:08 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:08.939556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:08.940277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:08.947281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.965892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:08.967173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:08.969378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.207814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.215902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a1bd4e1f-8e30-4410-ab26-da74f019be0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.280348 Jun 24 08:48:09.216489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 247/503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:09.784915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:09.786168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:09.792988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.793438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.794239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.794673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.924791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:09.933182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5ee7c7f6-dc84-426a-b969-e863c6f61eaf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1592 microversion: 2.1 time: 0.152086 Jun 24 08:48:09.933776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 257/504] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1592 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:09.936119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:09.936733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:09.943230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.943855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:09.944438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:09.944955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.075232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.083173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-103b1353-0f5f-41fc-afa6-7de4607370fe tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.150221 Jun 24 08:48:10.083732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 248/505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:09 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:10.233678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:10.234289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:10.240670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.241116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.241930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:10.242358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:10.467788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:10.475837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-77e9c2ed-8386-4dfb-a30c-1ac311775928 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.246094 Jun 24 08:48:10.476439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 258/506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:11.100758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:11.101382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:11.107612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.108067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.108854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.109297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.334544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:11.342204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a5330353-b750-4c37-8e8e-f3a6461c177c tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.245886 Jun 24 08:48:11.342773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 249/507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:11 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:11.492410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:11.493000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:11.501118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.501604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.502385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:11.503576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:11.749009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:11.757408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d7aa7b20-e3c1-47d8-9a15-f897cdbf8ac3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.268829 Jun 24 08:48:11.758047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 259/508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:12.287143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-bb8412cd-fbe8-4e50-85fd-6e6cbc4e0b59 req-73957f01-6b25-4a74-97e2-b91d73fd9d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:12.295524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-bb8412cd-fbe8-4e50-85fd-6e6cbc4e0b59 req-73957f01-6b25-4a74-97e2-b91d73fd9d3b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.295965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-bb8412cd-fbe8-4e50-85fd-6e6cbc4e0b59 req-73957f01-6b25-4a74-97e2-b91d73fd9d3b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.311243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-bb8412cd-fbe8-4e50-85fd-6e6cbc4e0b59 req-73957f01-6b25-4a74-97e2-b91d73fd9d3b service nova] Creating event network-changed:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:48:12.317500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-bb8412cd-fbe8-4e50-85fd-6e6cbc4e0b59 req-73957f01-6b25-4a74-97e2-b91d73fd9d3b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034465 Jun 24 08:48:12.318146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 250/509] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:12.360039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:12.361010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:12.366835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=78 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:12.369044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.369724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.370616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.371149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.517410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:12.527647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-64f3f6d9-ea8d-44a1-9cf1-b79bab417007 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.171391 Jun 24 08:48:12.528631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 260/510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:12 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:12.774392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:12.775228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:12.782207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.782667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.783555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:12.783992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:12.986080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.001693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0a757138-73a3-4b41-8a1a-2ec50891be68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.231040 Jun 24 08:48:13.002951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 251/511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:13.404072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2092168659"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:13.404615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:13.411483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.412110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.412796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.413167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.545028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.network.security_group_api [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Adding security group 37ec7606-9a32-4b8b-8f8f-bd3be715a0f5 to port de413bfc-c50c-48a1-8075-b9aa0f5c74d0 Jun 24 08:48:13.546558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:13.547175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:13.553472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.554429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.555213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.555648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.763431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:13.771941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-42c0ed50-a7da-454b-93aa-bf679255df7a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.230443 Jun 24 08:48:13.772616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 252/512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:13 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:13.777267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:13.777981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:13.783645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.784089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.784858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:13.785290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:13.809533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7919092e-180b-4b38-b9e8-ac814427344e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/ips" status: 200 len: 152 microversion: 2.20 time: 0.035721 Jun 24 08:48:13.810143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 253/513] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 24 08:48:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:48:14.013415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5ba6559c-4293-4527-a204-cde7c83934c5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action" status: 202 len: 0 microversion: 2.1 time: 0.612080 Jun 24 08:48:14.015570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 261/514] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:48:13 2022] POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:48:14.021545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.022569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.029826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.030378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.031454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.031965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.033144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.033687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.063437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.064295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.065831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.068361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.250076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.260243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c854d73e-82cb-43f5-9626-56a864d638dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.243278 Jun 24 08:48:14.261969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 254/515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:48:14.322133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.325554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8cae6bf7-d230-4b32-8876-d62f42687541 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1639 microversion: 2.1 time: 0.303802 Jun 24 08:48:14.326806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 262/516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1639 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:14.332731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-aaabb1aa-4f6c-4577-a53f-820a7308bdac req-ff9d3623-a3ed-4d2d-a775-987e40c6298b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:14.341581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-aaabb1aa-4f6c-4577-a53f-820a7308bdac req-ff9d3623-a3ed-4d2d-a775-987e40c6298b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.342259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-aaabb1aa-4f6c-4577-a53f-820a7308bdac req-ff9d3623-a3ed-4d2d-a775-987e40c6298b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.354328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-aaabb1aa-4f6c-4577-a53f-820a7308bdac req-ff9d3623-a3ed-4d2d-a775-987e40c6298b service nova] Creating event network-changed:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:48:14.359518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-aaabb1aa-4f6c-4577-a53f-820a7308bdac req-ff9d3623-a3ed-4d2d-a775-987e40c6298b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030399 Jun 24 08:48:14.360120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 255/517] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:48:14.788600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:14.789187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:14.795915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.796364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.797117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:14.797547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:14.938285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:14.946972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-49c2699d-8d80-4358-a1ee-007af3b2eb8f tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.162181 Jun 24 08:48:14.947556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 263/518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:14 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:15.277192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:15.277923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:15.284320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.284766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.286153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.286584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.424010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:15.433930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-46ff2318-e4c0-49ff-8c3d-cf56d0194157 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.160949 Jun 24 08:48:15.434517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 256/519] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:15.964320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:15.964880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:15.972016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.972487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:15.973251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:15.973704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.112492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.120105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b49c3760-ba5e-4a43-ad0f-891839f40569 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1318 microversion: 2.1 time: 0.159754 Jun 24 08:48:16.120675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 264/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:15 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:16.456722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:16.458093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:16.472315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.472939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.474133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:16.474882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:16.507399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:16.843731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:16.868219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-21cebf7e-db83-43f4-b7cb-9d244e23c1ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.420086 Jun 24 08:48:16.879122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 257/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:17.071633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:17.072208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.081197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.082290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.082940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.083378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.120257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lazy-loading 'flavor' on Instance uuid 6cb66bde-d133-41de-b6dd-295b0676be9e {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:48:17.133366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-691ae140-5af0-415c-80e2-f3685c14a901 req-a99b4fd0-133b-4ca7-9edf-09af086638b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "name": "network-vif-plugged", "status": "completed", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:17.147235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-691ae140-5af0-415c-80e2-f3685c14a901 req-a99b4fd0-133b-4ca7-9edf-09af086638b4 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.151129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-691ae140-5af0-415c-80e2-f3685c14a901 req-a99b4fd0-133b-4ca7-9edf-09af086638b4 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.169293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-691ae140-5af0-415c-80e2-f3685c14a901 req-a99b4fd0-133b-4ca7-9edf-09af086638b4 service nova] Creating event network-vif-plugged:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 08:48:17.175840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-691ae140-5af0-415c-80e2-f3685c14a901 req-a99b4fd0-133b-4ca7-9edf-09af086638b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045975 Jun 24 08:48:17.176965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 258/522] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:17.183208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:17.184161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.193182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.193961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.195153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.195869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.387486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:17.396300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2ad552dc-6a6f-4ae1-9b45-2b29b086629b tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1506 microversion: 2.1 time: 0.217696 Jun 24 08:48:17.397387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 259/523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:17 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:17.605761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48a1cb2e-6db9-48ea-8652-4c326817dfe4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action" status: 202 len: 0 microversion: 2.20 time: 0.538444 Jun 24 08:48:17.618384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:17.619537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.627027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 265/524] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 24 08:48:17 2022] POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:48:17.629100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=68 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:17.631249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.632120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.633138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.633890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.825384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:17.834885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:17.836399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:17.838009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2e89fe9e-d118-41ee-a2a3-d1157c94d366 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.225058 Jun 24 08:48:17.838557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 260/525] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:17.887116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:17.887945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:17.895236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.895744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:17.896589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:17.897125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:18.055315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:18.064000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba909ec5-8b75-419e-9de4-a5c6b5e3623e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.181102 Jun 24 08:48:18.065348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 266/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:18.860329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:18.861809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:18.868985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:18.869436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:18.870235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:18.870669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.017073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.025460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.027036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.028229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0e94062-76b1-471b-ade3-a472621b7bf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.172481 Jun 24 08:48:19.028791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 261/527] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:19.088533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:19.089143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:19.095855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.096306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.097573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:19.098041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:19.100683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:19.236292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:19.245233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7d742ad9-f2c6-40ad-8659-101065eb4b02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.160410 Jun 24 08:48:19.245868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 267/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:20.049843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:20.051215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:20.060179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.060644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.061440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.061917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.264378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:20.265012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:20.272581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.273760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.276051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:20.276560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:20.276722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.294783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.296613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.297987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee355552-b58b-487f-9b3a-b1887ead7fe8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.253889 Jun 24 08:48:20.298917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 262/529] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:20.492267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:20.499882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a4e0776-42da-4098-aea0-96df6dd0318d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.240768 Jun 24 08:48:20.500474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 268/530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:21.319124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.319812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.326183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.326634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.327417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.328037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.466406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.474697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.476213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.477416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5c7e8d4e-e102-41fb-a623-c0e48b125193 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.162859 Jun 24 08:48:21.477988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 263/531] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:21.517274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:21.518017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:21.525926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.526396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.527150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:21.527828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:21.702750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:21.724273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f7ac98bf-c519-47f1-a121-e66984240aea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1261 microversion: 2.1 time: 0.210974 Jun 24 08:48:21.724866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 269/532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:22.498160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:22.498754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:22.505434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.505921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.506701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.507137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.669344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.677739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.679258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.680595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d1c070a5-cf17-4319-8cd6-c146558e6614 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.189010 Jun 24 08:48:22.681367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 264/533] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:22.742397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:22.743228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:22.757181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.757626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.758429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.758858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.896497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:22.904345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3614fcf0-18c5-42c5-a70a-512997d15f23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1444 microversion: 2.1 time: 0.165771 Jun 24 08:48:22.905083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 270/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:22.923279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:22.923893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:22.930123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.930578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:22.931419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:22.931792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.087956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.095900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6a6e30ec-a024-4786-8865-bcbdf3bc534e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1444 microversion: 2.1 time: 0.176438 Jun 24 08:48:23.096466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 265/535] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:48:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:48:23.702312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:23.703315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:23.713126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.713126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.713126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:23.713126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:23.964924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.978507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.980943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:23.983392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-49eb6a5e-7b24-4dcc-83ca-aa3509264aeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.286939 Jun 24 08:48:23.984535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 271/536] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:25.010650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:25.012196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:25.019344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.020116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.021113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.021983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.467427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-7f1f3cec-61d1-40fe-93b5-c52d25c5124d req-cfd0ea63-d93b-496f-87f7-d793efcbd310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:25.479728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-7f1f3cec-61d1-40fe-93b5-c52d25c5124d req-cfd0ea63-d93b-496f-87f7-d793efcbd310 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:25.480481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-7f1f3cec-61d1-40fe-93b5-c52d25c5124d req-cfd0ea63-d93b-496f-87f7-d793efcbd310 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:25.503917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-7f1f3cec-61d1-40fe-93b5-c52d25c5124d req-cfd0ea63-d93b-496f-87f7-d793efcbd310 service nova] Creating event network-changed:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 08:48:25.514187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-7f1f3cec-61d1-40fe-93b5-c52d25c5124d req-cfd0ea63-d93b-496f-87f7-d793efcbd310 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051500 Jun 24 08:48:25.516052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 272/537] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:25.615665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:25.645599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:25.648390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:25.650252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e9f5f391-4ab5-4080-b3a1-55ee97693927 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.646515 Jun 24 08:48:25.655363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 266/538] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:26.676486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:26.677516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:26.695555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.696008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:26.696802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:26.697239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:27.018024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:27.031978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:27.035595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:27.038556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9019bffd-e4be-403a-82c1-13decbe3b090 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.366699 Jun 24 08:48:27.040484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 273/539] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:28.058666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:28.059345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:28.077705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.077705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.077705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:28.077705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:28.280371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.288788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.291666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:28.293821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-465e2403-6204-4585-9450-b7f52198a28e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.239724 Jun 24 08:48:28.294688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 267/540] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:29.312571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:29.316615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:29.324439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.324897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.325718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:29.326156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:29.482719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.491503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.493143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:29.494406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c46cc54c-f65f-4f96-9554-3b54f365ef1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.185818 Jun 24 08:48:29.495053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 274/541] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:30.517265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:30.519262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:30.535262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.536168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.537996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:30.539432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:30.729396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.742731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.744741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:30.746211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-46a13f5d-0c19-4269-b592-75d29649b844 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.235301 Jun 24 08:48:30.758828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 268/542] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:31.767562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:31.768944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:31.779920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.780828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.781876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:31.783160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:31.948039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:31.961688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:31.965449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:31.967033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-35effa2d-8524-4c66-ba41-6ac1f79923b5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.204827 Jun 24 08:48:31.968099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 275/543] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:32.986464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:32.987654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:33.004100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.004561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.005380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:33.005861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:33.284004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.295244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.296850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:33.298248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-860ae496-9a69-4b6f-a237-0342ad9a2c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.315820 Jun 24 08:48:33.300030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 269/544] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:34.328531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:34.329348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:34.356533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.357135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.358176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:34.359187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:34.597271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.620811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.622338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:34.628116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67c8f817-3af6-43d9-87d8-f72a1e0f95b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1723 microversion: 2.20 time: 0.303764 Jun 24 08:48:34.629351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 276/545] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:34.973106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-af556068-a803-427b-9ba7-92a54d3a99fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Action: 'create', calling method: .version_select at 0x7fa68c354ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-763813610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPHKe4lgR5DCvyXaq47FLLkUUxVhCVD78KYQgIg7OtCAqL603MReUJnEEFHBiLCIrF0t7WR2qQxyhR2q5r8xFKqetk8qi/Fhd3ANmUd+Y31qUOia4Ox0wRblDuHOCU1ZA=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:34.988960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-af556068-a803-427b-9ba7-92a54d3a99fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for project dd57cef0777f4a34a27bf60518a801da. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:48:34.994702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-af556068-a803-427b-9ba7-92a54d3a99fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for user 8a25c8981df44bb285f37ef333c90f8a and project dd57cef0777f4a34a27bf60518a801da. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:48:35.028481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-af556068-a803-427b-9ba7-92a54d3a99fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.267199 Jun 24 08:48:35.028974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 270/546] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:48:34 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:35.650217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:35.651245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:35.660646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.661374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.662829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:35.663534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:35.874284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.883746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.885255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:35.886624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b75311f-1987-4588-916d-7530df1d87dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.241860 Jun 24 08:48:35.887212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 277/547] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:36.906471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:36.907834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:36.914955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.915474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:36.916818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:36.917390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:37.067520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:37.075787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:37.077305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:37.078538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-79eca325-16c9-4790-8437-2a102a82ba36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.176317 Jun 24 08:48:37.079119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 271/548] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:38.099069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:38.099820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:38.108819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.110355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.112753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:38.113759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:38.332795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:38.349875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:38.351860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:38.353365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07d343b1-3188-46df-b869-b1f52fa30184 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.259476 Jun 24 08:48:38.365026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 278/549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:48:38.990465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-7956ea9b-a088-4c56-93ae-7c42c4c66bf9 req-e4ecd845-37e1-47d7-b76a-9084ab313c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "name": "network-vif-plugged", "status": "completed", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:39.002781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-7956ea9b-a088-4c56-93ae-7c42c4c66bf9 req-e4ecd845-37e1-47d7-b76a-9084ab313c6e service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.003578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-7956ea9b-a088-4c56-93ae-7c42c4c66bf9 req-e4ecd845-37e1-47d7-b76a-9084ab313c6e service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.023891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-7956ea9b-a088-4c56-93ae-7c42c4c66bf9 req-e4ecd845-37e1-47d7-b76a-9084ab313c6e service nova] Creating event network-vif-plugged:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:48:39.031962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-7956ea9b-a088-4c56-93ae-7c42c4c66bf9 req-e4ecd845-37e1-47d7-b76a-9084ab313c6e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045559 Jun 24 08:48:39.033039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 272/550] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:39.371667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:39.372278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:39.378988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.379438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.380210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:39.380643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:39.521417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:39.530056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:39.531853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:39.534020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06c81bf2-f58f-49f6-828d-72cc0729f934 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.165568 Jun 24 08:48:39.534809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 279/551] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:40.554188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:40.554881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:40.561120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.561569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.562382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:40.562816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:40.704641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:40.712929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:40.714472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:40.715677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d3221ef1-738f-4bb7-b24e-687f2ed2267f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.165838 Jun 24 08:48:40.716238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 273/552] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:41.735111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:41.735695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:41.742236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.742688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.743448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:41.743883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:41.875511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:41.884156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:41.885651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:41.886850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a2aef45a-faae-4634-b3d4-d6a0227f6c29 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.155665 Jun 24 08:48:41.887415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 280/553] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:42.908085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:42.909274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:42.918162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.918625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:42.919452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:42.919894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:43.158477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:43.167351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:43.168858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:43.170204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee23c7ee-df53-4bc9-8ee6-ef92965c51f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.269145 Jun 24 08:48:43.170812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 274/554] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:44.189323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:44.189934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:44.192075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=42 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:44.197492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.197959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.198725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:44.199151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:44.417072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.425336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.426881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:44.428070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f7fa4f93-545c-4ce7-a8bc-fcaf68676a83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.242929 Jun 24 08:48:44.428627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 281/555] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:45.456527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:45.457646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:45.459734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:45.465485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.465963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.466733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:45.467170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:45.607499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:45.618205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:45.620402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:45.621928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1eebed3b-d0d5-463a-b35e-784560bb9d6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.169338 Jun 24 08:48:45.622508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 275/556] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:46.640079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:46.640684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:46.648185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:46.648705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.649501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:46.650105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:46.787156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:46.795523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:46.797013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:46.798208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e053151f-7d7e-4bca-89fc-249cae902c24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1744 microversion: 2.20 time: 0.162097 Jun 24 08:48:46.799064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 282/557] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:47.816452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:47.817060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:47.819006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:47.824301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.824741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:47.825504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:47.825963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:47.829517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:47.967957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:47.977992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:47.979974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:47.981477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-93c4035b-0e69-44d3-8074-c56eda0bd04a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.168885 Jun 24 08:48:47.985720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 276/558] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:49.002723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:49.003329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:49.010725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.011258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.012110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.012619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.078126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49ffa3dc-e1e2-4719-8480-dce421e15448", "device": "/dev/sdb"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:48:49.080037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:49.102045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.102643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.103529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:49.104488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:49.214776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:49.217479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=96 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:49.226768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:49.228222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:49.230280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8cfdef92-ead1-4d1b-b535-0d220a29c949 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.231827 Jun 24 08:48:49.241575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 283/559] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:49.473822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6feb953f-237c-4973-9071-84998e27deaf tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "POST /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399184 Jun 24 08:48:49.475121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 277/560] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 08:48:49 2022] POST /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:48:50.249058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:50.249849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:50.256994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.257440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.258237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:50.258668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:50.421254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.431304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.433409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:50.434830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-64e3f4b3-4afa-4588-a083-2a06be004a86 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.189731 Jun 24 08:48:50.446606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 284/561] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:51.454678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:51.456152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:51.464541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:51.465277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:51.466350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:51.467020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:51.633570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:51.642846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:51.646039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:51.647495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d7b9fc5b-50ec-4ee5-9d95-538311e3ab0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.197824 Jun 24 08:48:51.658720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 278/562] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:52.667097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:52.667717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:52.674412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:52.674867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:52.675675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:52.676843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:52.826063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:52.840753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:52.843697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:52.845910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e351e02-3ccb-4de9-9a80-ea59699b054b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.182658 Jun 24 08:48:52.853186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 285/563] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:53.865313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:53.865941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:53.872511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.872953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:53.873746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:53.874186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:54.010245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:54.026043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:54.031813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:54.034184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-057301c5-7825-4210-a5f2-29c194af73a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.172445 Jun 24 08:48:54.036253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 279/564] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:55.054521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:55.055162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:55.063452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:55.063903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:55.064723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:55.065162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:55.217013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:55.233345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:55.236605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:55.238164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-98b1befc-24e7-48c3-b6ef-0a8ee08c7630 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.188121 Jun 24 08:48:55.238948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 286/565] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:56.264874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:56.265486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:56.272325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.272774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.274029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:56.274029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:56.420428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:56.431307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:56.432800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:56.434012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8f0639f-fc40-4c58-99d6-7429e8cab050 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.173756 Jun 24 08:48:56.434579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 280/566] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:57.452666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:57.453318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:57.461558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.462314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.463306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:57.464031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:57.651246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:57.660589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:57.662204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:57.663638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8bd18fd1-30fa-4ad0-810c-7f5ec6978d7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.215041 Jun 24 08:48:57.664493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 287/567] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:58.681934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:58.682539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:58.689086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.689535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.690335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:58.690775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:58.821702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:58.830375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:58.832631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:48:58.833921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9fb8c243-77f5-45cb-8b9b-7e3f05642c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.155859 Jun 24 08:48:58.835133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 281/568] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:48:59.852284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:48:59.852983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:48:59.859638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.860089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:48:59.860863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:48:59.861300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:00.008545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:00.016802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:00.018461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:00.019687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-edbda2f1-7ad4-44e5-8427-0900633fdc44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.171264 Jun 24 08:49:00.020241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 288/569] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:48:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:01.039625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:01.040225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:01.047169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.047619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.048389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:01.048819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:01.187528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:01.196282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:01.197888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:01.199322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-82f4b441-8386-49ce-abec-9bb90c1925f6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.163874 Jun 24 08:49:01.200358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 282/570] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:02.219157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:02.219999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:02.229901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.230927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.231983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:02.232373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:02.387781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:02.398120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:02.399801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:02.401229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47339e65-745c-48c0-9160-ee9bf5ba9cbc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.186651 Jun 24 08:49:02.402134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 289/571] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:03.530185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:03.530970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:03.538128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.538580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.539358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:03.539796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:03.681477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:03.689713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:03.691257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:03.692464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aaf20dbf-2678-420f-ac55-3672ff0800d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.276411 Jun 24 08:49:03.693038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 283/572] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:03.694550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:49:03.695032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 08:49:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:49:04.711339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:04.712020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:04.719071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.719521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:04.720295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:04.720727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:04.852629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:04.860586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:04.862154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:04.863925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b5995f6-9775-44f4-90b4-cfdfa3632c5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.156527 Jun 24 08:49:04.864479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 290/573] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:05.882328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:05.882872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:05.889317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:05.889814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:05.890581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:05.891031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:06.020288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:06.028187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:06.029708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:06.030876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-37ac71ca-641b-450e-90a4-461932666763 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.152650 Jun 24 08:49:06.031440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 284/574] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:07.050632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:07.051242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:07.057768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:07.058220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:07.058983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:07.059418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:07.187056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:07.195763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:07.197247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:07.198431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8a717c1a-88dc-4d8a-b716-e1be6039ff42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.151733 Jun 24 08:49:07.198983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 291/575] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:08.216402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:08.217026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:08.224058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.224502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.225256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:08.225702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:08.353372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:08.361373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:08.362906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:08.364446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a427b0de-0b49-4c00-a5cc-969a061c7221 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.151717 Jun 24 08:49:08.365376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 285/576] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:09.383503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:09.384103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:09.390570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:09.391019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:09.391772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:09.392198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:09.523720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:09.531593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:09.533081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:09.534829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ec8532a8-1a8c-4668-b31a-24a7901b956f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.154855 Jun 24 08:49:09.535386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 292/577] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:10.552901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:10.553439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:10.560022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:10.560467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:10.561221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:10.561653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:10.695108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:10.703338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:10.704826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:10.706028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bee7223a-76f3-4162-a350-f9ff2b58cb47 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1739 microversion: 2.20 time: 0.157612 Jun 24 08:49:10.706579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 286/578] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:10.940972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-35338482-4acb-4987-8182-0f6f56842740 req-315dd4fb-db0a-4f59-a844-b6b7e24739d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "name": "network-vif-unplugged", "status": "completed", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:10.950122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-35338482-4acb-4987-8182-0f6f56842740 req-315dd4fb-db0a-4f59-a844-b6b7e24739d7 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:10.950573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-35338482-4acb-4987-8182-0f6f56842740 req-315dd4fb-db0a-4f59-a844-b6b7e24739d7 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:10.962203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-35338482-4acb-4987-8182-0f6f56842740 req-315dd4fb-db0a-4f59-a844-b6b7e24739d7 service nova] Creating event network-vif-unplugged:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:49:10.967188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-35338482-4acb-4987-8182-0f6f56842740 req-315dd4fb-db0a-4f59-a844-b6b7e24739d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029923 Jun 24 08:49:10.967772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 293/579] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:11.725307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:11.726091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:11.732841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:11.733290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:11.734269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:11.734866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:11.907772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:11.916087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:11.917585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:11.918830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-63e3707f-a5fa-43ee-97fc-37023a58e27c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.197496 Jun 24 08:49:11.919386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 287/580] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:12.939643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:12.940257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:12.946435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:12.946873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:12.947629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:12.948055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:13.081012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:13.089010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:13.090537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:13.091691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5884417-de9a-4579-b5d6-d9a91a9d7d25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.156951 Jun 24 08:49:13.092398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 294/581] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:14.113026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:14.113629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:14.120568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:14.121023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:14.121837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:14.122305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:14.252070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:14.259931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:14.261418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:14.262594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-433743f1-c6e9-481a-8e86-01bcee393216 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.153485 Jun 24 08:49:14.263154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 288/582] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:15.281315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:15.281999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:15.284902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:15.290539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:15.290981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:15.291734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:15.292161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:15.417191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:15.425651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:15.427253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:15.428394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-223e6906-170e-461c-a0a3-54c08d7e3395 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.150953 Jun 24 08:49:15.428948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 295/583] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:16.446548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:16.447159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:16.453619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:16.454106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:16.454902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:16.455335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:16.582660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:16.590580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:16.592081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:16.593239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-07a7e0b9-03c7-4daf-8f91-e49ea016c162 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.150628 Jun 24 08:49:16.593830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 289/584] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:17.612645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:17.613277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:17.619876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:17.620316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:17.621069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:17.621493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:17.762255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:17.774765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:17.777419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:17.779366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85a7987a-3be8-4b7f-883c-ae1d967962d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.170668 Jun 24 08:49:17.780274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 296/585] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:18.807021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:18.807629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:18.810105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:18.816190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:18.816633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:18.817409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:18.817909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:18.822503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:18.965446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1841921299", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763813610", "security_groups": [{"name": "tempest-secgroup-smoke-31330578"}], "block_device_mapping_v2": [{"uuid": "24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cd6db2d-add9-420a-b2b7-857a38cb2a1c"}]}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:18.966616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:18.974658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:18.976167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:18.977360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9b3d98e8-1b30-4c9d-905c-f443a2442aa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.174274 Jun 24 08:49:18.978068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 290/586] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:19.076400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] validate_networks() for [('9cd6db2d-add9-420a-b2b7-857a38cb2a1c', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:49:19.490641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:49:19.491057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:49:19.491522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:49:19.491918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:49:19.492318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:49:19.501003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:19.501442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:19.502268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:19.502705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:19.519472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for project dd57cef0777f4a34a27bf60518a801da. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:49:19.523342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for user 8a25c8981df44bb285f37ef333c90f8a and project dd57cef0777f4a34a27bf60518a801da. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:49:19.581466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:49:19.584134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf',volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:49:19.717326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3dc5968c-0cfa-4177-9267-ea161d2823a8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.756077 Jun 24 08:49:19.718094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 297/587] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:49:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:49:19.729117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fdf41da6-44fc-47fd-94a1-14e79d0c9d1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:19.729753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fdf41da6-44fc-47fd-94a1-14e79d0c9d1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:19.786896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fdf41da6-44fc-47fd-94a1-14e79d0c9d1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:19.793817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fdf41da6-44fc-47fd-94a1-14e79d0c9d1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1094 microversion: 2.1 time: 0.068651 Jun 24 08:49:19.794405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 291/588] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:19 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:19.995826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:19.996436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:20.003218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:20.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:20.004441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:20.004872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:20.141471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:20.151121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:20.153029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:20.154251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-10e58105-e33f-4ef5-af7d-a8cab9a98675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1721 microversion: 2.20 time: 0.162428 Jun 24 08:49:20.154878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 298/589] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:20.811783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:20.812489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:20.820567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:20.821029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:20.821964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:20.822419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:20.890037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:20.898348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4b56a754-65c5-491e-8181-8273c0a6ea6d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1192 microversion: 2.1 time: 0.090585 Jun 24 08:49:20.898932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 292/590] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:21.174167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:21.174797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:21.181181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.181650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.182437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.182864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.185365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:21.364726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:21.372613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:21.374142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:21.375288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0cb567c8-f5b0-4751-bf32-89b4f71ef199 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1724 microversion: 2.20 time: 0.205191 Jun 24 08:49:21.375853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 299/591] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:21.399590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a6a60d3-9943-4f53-9f4d-b6b0de058fb2"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:21.401058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:21.407635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.408206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.409234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.409906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.626110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:21.627131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:21.634900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.635586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.636532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.636969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.748275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5436b019-62a7-48b2-a237-54e4706bd70f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358575 Jun 24 08:49:21.748988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 293/592] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 24 08:49:21 2022] POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:49:21.780940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lazy-loading 'services' on Instance uuid 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:49:21.883494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:21.884149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:21.891451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.892243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.893046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.893622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.938071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f50dc3d6-5427-4149-990c-4acedf21f86a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed/os-volume_attachments/49ffa3dc-e1e2-4719-8480-dce421e15448" status: 202 len: 0 microversion: 2.1 time: 0.319080 Jun 24 08:49:21.941959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 300/593] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 08:49:21 2022] DELETE /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed/os-volume_attachments/49ffa3dc-e1e2-4719-8480-dce421e15448 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:49:21.956179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:21.956908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:21.966260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.966933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:21.970838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:21.972626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:22.156838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24ca99d0-dba8-4481-beb0-c97612f6c7a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action" status: 202 len: 0 microversion: 2.20 time: 0.277571 Jun 24 08:49:22.157575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 294/594] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 24 08:49:21 2022] POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 08:49:22.169292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:22.170003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:22.185947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:22.186603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:22.187437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:22.187883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:22.209067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:22.219422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a22b48d3-1a74-4217-8a42-7982980c1926 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1276 microversion: 2.1 time: 0.273761 Jun 24 08:49:22.220268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 301/595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1276 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:22.351504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:22.360815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:22.362839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:22.364030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-126d27ce-52a8-48a3-a695-555c1b130a90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1750 microversion: 2.20 time: 0.200127 Jun 24 08:49:22.365509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 295/596] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1750 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:23.237701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:23.247622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:23.261548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:23.268121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:23.269197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:23.269869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:23.384802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:23.385391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:23.393016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:23.393504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:23.394516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:23.394950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:23.548707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:23.556792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-391ded5a-de72-487a-9dac-3ea375cd885e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.324021 Jun 24 08:49:23.557363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 302/597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:23 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:23.623843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:23.634064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:23.635829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:23.637011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-57c02ef5-53b8-4795-8f81-bcf21588f259 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1752 microversion: 2.20 time: 0.256146 Jun 24 08:49:23.637587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 296/598] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1752 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:23.799497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-33db5866-7ec6-4936-aab6-c00e52d33f70 req-237733f4-36e3-4322-8294-a7d47af25e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddcaa83-a766-4122-8923-3bb23b844391", "tag": "a335388c-49c2-4c7a-afdc-1bab81d059f5"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:23.810881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-33db5866-7ec6-4936-aab6-c00e52d33f70 req-237733f4-36e3-4322-8294-a7d47af25e67 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:23.811330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-33db5866-7ec6-4936-aab6-c00e52d33f70 req-237733f4-36e3-4322-8294-a7d47af25e67 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:23.823759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-33db5866-7ec6-4936-aab6-c00e52d33f70 req-237733f4-36e3-4322-8294-a7d47af25e67 service nova] Creating event network-changed:a335388c-49c2-4c7a-afdc-1bab81d059f5 for instance 9ddcaa83-a766-4122-8923-3bb23b844391 on hv-cinder-78729 Jun 24 08:49:23.829830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-33db5866-7ec6-4936-aab6-c00e52d33f70 req-237733f4-36e3-4322-8294-a7d47af25e67 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110305 Jun 24 08:49:23.830437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 303/599] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:24.179085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:24.179589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:24.185887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.186438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.187399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.187833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.218197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:49:24.295333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f8cd7e19-66e5-426e-9af3-00305de494e5 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 204 len: 0 microversion: 2.1 time: 0.120786 Jun 24 08:49:24.296104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 297/600] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:49:24 2022] DELETE /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:49:24.305032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:24.305748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:24.312300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.312741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.313494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.313977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.446268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:24.454195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d26ce72e-2584-4a85-851b-15d2ebb66a51 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1512 microversion: 2.1 time: 0.153256 Jun 24 08:49:24.454797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 304/601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:24 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:24.575072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:24.575674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:24.582656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.583105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.583864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.584297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.656430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:24.657036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:24.664093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.664540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.665311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:24.665771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:24.751234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:24.759707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9d49abbe-7823-4eb5-81d7-61fe7f11bf23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.188888 Jun 24 08:49:24.760288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 298/602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:24.817591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:24.827297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:24.828711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:24.829899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07910a0a-f0b5-49a7-8422-0a024ba0e5df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1752 microversion: 2.20 time: 0.177450 Jun 24 08:49:24.830454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 305/603] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:25.472658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:25.473264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:25.479218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.479660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.480417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.480849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.606636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:25.614579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cf74eaaa-b4fb-4485-835d-6f4d301280b9 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1512 microversion: 2.1 time: 0.146490 Jun 24 08:49:25.615147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 299/604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:25 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:25.776344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:25.776949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:25.783482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.783928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.784695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.785119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.848630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:25.848989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:25.854987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.855432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.856200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:25.856642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:25.957336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:25.965296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2614bedc-df31-4d6b-91c4-0eca60c9a9d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.192774 Jun 24 08:49:25.966041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 306/605] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:25.999968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:26.008875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:26.010407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:26.011595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d2db26d6-009d-4287-8fde-32d0f2ee71ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1752 microversion: 2.20 time: 0.167213 Jun 24 08:49:26.012151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 300/606] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:26.631898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:26.632511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:26.638610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:26.639071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:26.639829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:26.640263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:26.772049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:26.779528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87a89079-3d1d-49ab-bf53-586c0d31c69a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1512 microversion: 2.1 time: 0.151514 Jun 24 08:49:26.780175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 307/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:26 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:26.982493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:26.983186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:26.989600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:26.990088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:26.990858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:26.991293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:27.030793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:27.031416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:27.039271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:27.039727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:27.040682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:27.041125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:27.293358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:27.300384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:27.301982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ad2b6a4a-a4f3-4930-8e18-081ce95d8b6f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.323500 Jun 24 08:49:27.302585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 301/608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:27.312716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:27.314258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:27.315964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a6152a6d-4b2d-4075-bfef-1f7e9741522c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1752 microversion: 2.20 time: 0.289444 Jun 24 08:49:27.316588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 308/609] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1752 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:27.797503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:27.798137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:27.804834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:27.805282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:27.806082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:27.806531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:27.822297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:27.980399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:27.991028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0c6d4184-93fd-492a-b21e-c8917bfe5e23 tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1512 microversion: 2.1 time: 0.196431 Jun 24 08:49:27.991028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 302/610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:27 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1512 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:28.320763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:28.321379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:28.328564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:28.329007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:28.329826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:28.330256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:28.336370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:28.337348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:28.344227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:28.344949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:28.345995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:28.347288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:28.547010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:28.555041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-23215bc7-5f91-4f5d-bab2-812eb7700408 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.238869 Jun 24 08:49:28.556185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:28 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:28.571476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:28.580495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:28.582597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:28.583783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6300aa02-0aa2-4218-ae7c-40659b3c5d77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.251777 Jun 24 08:49:28.584429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 303/612] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:29.008167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:29.009207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:29.026975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.027435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.028235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.028674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.097082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-e34023cf-d1ea-4d2b-9e24-0fa8ffb0ab88 req-0e81cd60-bf79-46e1-a600-63f36fd6a201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed", "name": "network-vif-deleted", "tag": "8ab0f10b-0afc-4dfa-8c24-26274083afe3"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:29.106439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-e34023cf-d1ea-4d2b-9e24-0fa8ffb0ab88 req-0e81cd60-bf79-46e1-a600-63f36fd6a201 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.107217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-e34023cf-d1ea-4d2b-9e24-0fa8ffb0ab88 req-0e81cd60-bf79-46e1-a600-63f36fd6a201 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.118406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '215190af23614b10853fdff03dc3d8cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:29.124541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-e34023cf-d1ea-4d2b-9e24-0fa8ffb0ab88 req-0e81cd60-bf79-46e1-a600-63f36fd6a201 service nova] Creating event network-vif-deleted:8ab0f10b-0afc-4dfa-8c24-26274083afe3 for instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed on hv-cinder-78729 Jun 24 08:49:29.126426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4ca67695-5050-4650-836e-1af1c982a91a tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 200 len: 1470 microversion: 2.1 time: 0.122141 Jun 24 08:49:29.127035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 304/613] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:29 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 1470 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:29.131448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-e34023cf-d1ea-4d2b-9e24-0fa8ffb0ab88 req-0e81cd60-bf79-46e1-a600-63f36fd6a201 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140604 Jun 24 08:49:29.132048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 310/614] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:49:29.571858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:29.572472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:29.580623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.581178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.582399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.583676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.604828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:29.606005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:29.613616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:29.615047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:29.619956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.620613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.621596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:29.622244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:29.791906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:29.918250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:29.924409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:29.930073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-20c5b4bf-8b4f-4ca8-a230-e3331f4dd349 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.361819 Jun 24 08:49:29.940487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 305/615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:29 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:29.950790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:29.953408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:29.955069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-041d59bb-b0af-41aa-a811-842ce58292f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.354824 Jun 24 08:49:29.966809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 311/616] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:30.144985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:30.145595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] [instance: 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:30.152677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.153123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:30.153937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.154375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:30.175519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] HTTP exception thrown: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Request method failure captured: Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed HTTP/1.1 Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXosbEbUhvsQbmjgHVVJ5wbiEs0cjpjUYud6uZUZ17lKKQHsLhKv9ItmuK5FNioU-4mo4bDYN6KQiP3MK5JTJEkiJ7PkIT3fhr9JiuBiAi_h4mVyLqjBDulTNUOVQ-nJ4pSTAa9WMW-xbvc8LhhIQkgQza-FS89gNhw2EbTfDIMvmvc Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 7e56778eb68e4cf3b1041ac4b23e3d8d Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesSnapshotTestJSON-234971413 Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:49:30.177849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7e56778eb68e4cf3b1041ac4b23e3d8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7e56778eb68e4cf3b1041ac4b23e3d8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7e56778eb68e4cf3b1041ac4b23e3d8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7e56778eb68e4cf3b1041ac4b23e3d8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesSnapshotTestJSON-234971413 Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 7e56778eb68e4cf3b1041ac4b23e3d8d Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-234971413 Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesSnapshotTestJSON-234971413-project Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 215190af23614b10853fdff03dc3d8cb Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesSnapshotTestJSON-234971413-project Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. Jun 24 08:49:30.179378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed'} Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:49:30.180299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. Jun 24 08:49:30.181846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:49:30.184528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] Returning 404 to user: Instance 3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:49:30.185643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2a72ca53-3904-4575-843d-f613db6f649e tempest-VolumesSnapshotTestJSON-234971413 tempest-VolumesSnapshotTestJSON-234971413-project] 10.222.0.48 "GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed" status: 404 len: 111 microversion: 2.1 time: 0.045174 Jun 24 08:49:30.191081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 306/617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:30 2022] GET /compute/v2.1/servers/3ca6c1e9-80b1-4df3-9133-6d8b22cbfbed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:49:30.947029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:30.947611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:30.954033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.954475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:30.955230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.955658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:30.975277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:30.979364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:30.993769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.994323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:30.995191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:30.995703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:31.167527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:31.176599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-adc82b71-88fd-4e4f-8649-02419b0a254f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.233165 Jun 24 08:49:31.177302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 312/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:31.188971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:31.197618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:31.199089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:31.200248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb1ef5f7-d896-411b-88e3-3fef61357b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.229973 Jun 24 08:49:31.200807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 307/619] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:32.194581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:32.195173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:32.201645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:32.202125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:32.202882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:32.203313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:32.219080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:32.219681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:32.226145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:32.226749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:32.227516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:32.227948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:32.382908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:32.391007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5c31ab6d-a3e0-4988-b3ec-b85ef49ee155 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.200939 Jun 24 08:49:32.391593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 313/620] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:32.404762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:32.413998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:32.415388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:32.416549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4beaf6fc-bcdd-4856-b6e9-9be2cd36a119 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.201371 Jun 24 08:49:32.417105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 308/621] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:33.408209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:33.408923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:33.416919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.417418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.418247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.418859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.435918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:33.436525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:33.449534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.450710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.452767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:33.453365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:33.624320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:33.632565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7e367ca2-81b1-4957-85b4-28e726f559aa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.228256 Jun 24 08:49:33.633135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 314/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:33.651063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:33.660130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:33.661544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:33.663143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-601aed83-a5f0-4ff1-a653-eb996b6b9bd9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.231050 Jun 24 08:49:33.663814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 309/623] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:34.649471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:34.650285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.656751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.657204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.658020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.658449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.681410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:34.682162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:34.688455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.688902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.689768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:34.690168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:34.869726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:34.879795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-daf170e6-1ee5-4eae-be41-7cc8d35e5a24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.233868 Jun 24 08:49:34.881001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 315/624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:34.906119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:34.916251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:34.917798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:34.918993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ea846d62-efef-4dc5-bffb-207a6bbf3239 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.241510 Jun 24 08:49:34.919558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 310/625] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:35.898663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:35.899219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:35.905813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.906259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.907018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.907448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.928752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:35.947486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:35.950397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:35.968703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.968703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:35.968703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:35.969265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:36.177455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.188899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5dbb03f8-9c01-4723-aa0d-4beb7278d976 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.294720 Jun 24 08:49:36.188899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 316/626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:35 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:36.210037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.218742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.220252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:36.221444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3c96e9d1-b977-4001-bea5-8594578f2650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.285671 Jun 24 08:49:36.222021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 311/627] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:37.209222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:37.210686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:37.218461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.218916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.219715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.220168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.248834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:37.248834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:37.261624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.262464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.263875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:37.264654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:37.437840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.445817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-25b83365-927b-4d43-b979-c2f346f4778d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.243109 Jun 24 08:49:37.455940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 317/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:37.490280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.500270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.502353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:37.503824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-615ab74d-a2ec-4c55-b3aa-7dbf799e35b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.267538 Jun 24 08:49:37.515313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 312/629] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:38.467878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:38.470513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:38.489760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.491079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.492792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.493860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.529885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:38.532312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:38.546223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.547051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.548473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:38.549285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:38.724434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.733167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-38577236-0220-4875-873b-c2fe26e7f4d9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.273144 Jun 24 08:49:38.733793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 318/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:38.759257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.775540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.777029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:38.778241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4b41e729-2392-4b67-b2a6-03f94574a4d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.257510 Jun 24 08:49:38.778799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 313/631] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:39.751725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:39.752380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:39.760287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.760745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.761562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.762027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.796403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:39.797143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:39.810730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.810848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.811889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:39.812426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:39.980953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:39.988834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-25939519-b11a-4c4f-b0e4-55d008b07586 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.240991 Jun 24 08:49:39.989432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 319/632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:39 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:40.007523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.016654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.018171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:40.019953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d299d781-299e-4fff-9ea0-21fc43dc89cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.227567 Jun 24 08:49:40.020529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 314/633] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:41.005936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:41.006501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:41.013475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.014011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.014794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.015229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.039322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:41.039933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:41.047191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.047675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.048473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:41.048904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:41.241264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.253949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-944db390-61e0-4d64-a23d-c68d75fb4948 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.252034 Jun 24 08:49:41.255078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 320/634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:41.257300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.272055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.274561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:41.275889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ab2e30dc-26e1-4b64-93da-96d4831f94c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.240769 Jun 24 08:49:41.276734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 315/635] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:42.271793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:42.272421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:42.279065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.279510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.280279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.280704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.295761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:42.296366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:42.303971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.304419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.305647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:42.306106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:42.502170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.510182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.510586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-63487916-a0df-458b-858e-5f4e20c08df6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.242804 Jun 24 08:49:42.511179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 321/636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:42 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:42.520191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.521763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:42.522961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-023d47e8-43d6-4ff5-a650-841a8a509f73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.231089 Jun 24 08:49:42.523521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 316/637] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:43.528225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:43.529012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:43.536556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.537013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.537830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.538266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.541950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:43.542593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:43.549147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.549749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.550525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:43.550956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:43.747162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.750276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.755444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ccadfb4d-5c09-42ce-8a2d-0184e4a1c240 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.231462 Jun 24 08:49:43.756187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:43.759368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.760853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:43.762058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c667ba74-1a7d-48ea-9164-2e7c514e00dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.224213 Jun 24 08:49:43.762803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 317/639] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:44.772814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:44.773446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:44.780027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.780176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:44.780573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.780697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:44.781231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.781682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.788150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.788596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.789361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:44.789820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:44.980324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:44.981772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:44.987965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e46a24a-a964-4b49-887a-e25cb5e1a6b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.219455 Jun 24 08:49:44.988546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 323/640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:44.990213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:44.991714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:44.992836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d4f945f-a2e7-4524-aab5-19c1e51fa605 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.216634 Jun 24 08:49:44.993381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 318/641] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:46.005166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:46.005926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.008274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:46.010875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:46.011484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.014113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.014565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.015341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.015929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.018025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.019169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.019942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.020514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.219730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.222869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:46.228600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.230360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.231858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:46.233026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d7c2e5d6-acb1-4e46-9d92-f7c96da5d51f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.226155 Jun 24 08:49:46.233616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 319/642] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:46.236197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-018087d0-7826-44a1-8b96-90d4c7ee2ab4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.235601 Jun 24 08:49:46.236827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 324/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:46.802793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:49:46.803843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:46.810237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.810685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:46.811458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:46.811894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.252517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.253154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.261980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.262423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.263182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.263612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.400111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.408444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.409960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.411110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b8842cec-127d-43cd-9c74-9a6a545f87da tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.162640 Jun 24 08:49:47.411923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 325/644] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:47.416326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:47.416919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:47.422538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.422982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.423738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:47.424171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:47.557304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:47.564995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cb1e0c30-3ea9-41b8-95c2-07907b8beec3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.152066 Jun 24 08:49:47.566164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 326/645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:47 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:48.429408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:48.430118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:48.436551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.436996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.437783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.438221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.565316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.573752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.575257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.576424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-db0459fe-5b11-44fb-b22d-8d7839e93536 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.150906 Jun 24 08:49:48.577153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 327/646] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:48.582075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:48.582674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:48.588437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.588884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.589706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:48.590153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:48.719012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:48.727042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e844a4c-afc4-4a5d-90a4-497475ef023d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.148934 Jun 24 08:49:48.727598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 328/647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:49.595181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:49.595990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:49.602741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.603189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.603947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.604381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.735667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.744994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.746530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.747701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-da5f1ba1-ec6d-4117-b7b4-1f769b1df23f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.156415 Jun 24 08:49:49.748260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 329/648] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:49.752647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:49.753252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:49.759799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.760247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.761104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:49.761573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:49.898627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:49.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5188bbfa-020b-4eb0-ab3a-f4854b9c47c0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157120 Jun 24 08:49:49.907056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 330/649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:49 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:50.766755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:50.767429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:50.774032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.774486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.775247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.775680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.909418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.919391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.920934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:50.922149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a8971b40-c5e4-4932-8ae0-6885c44aec92 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.159298 Jun 24 08:49:50.922726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 331/650] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:50.927912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:50.928516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:50.934979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.935431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:50.936211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:50.936647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.351169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:51.360092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d0a9272c-6c8e-4013-b8b5-61f2f930356d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.436217 Jun 24 08:49:51.360687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 332/651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:51.942086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:51.942731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:51.949125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.949574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.950390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:51.950827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:51.953402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:52.092868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.101493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.102996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.104169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cebaf607-2aad-4108-8063-bb8bf47f0628 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.166742 Jun 24 08:49:52.104736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 333/652] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:52.378727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:52.379625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:52.386020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:52.386571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:52.387358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:52.387792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:52.530287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:52.538834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6c5f9033-f67d-4a45-928b-827127fba8ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.164513 Jun 24 08:49:52.539401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 334/653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:52 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:53.125162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.127744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:53.139871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.141186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.142730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.144196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.355402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.364374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.365916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.367269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3c69765d-12e3-4b2a-91fc-552c79de39dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.248164 Jun 24 08:49:53.367832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 335/654] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:49:53.555567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:53.556087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:53.562242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.562689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.563453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:53.563883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:53.701099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:53.709536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a32f0e95-a003-4060-8230-1422f30b38f2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157762 Jun 24 08:49:53.710180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 336/655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:54.386460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:54.387174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:54.394552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.395021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.395952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.396382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.534141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.543266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.544782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.545984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6dc7e058-cff4-4702-87dd-cfd551f30a07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.163443 Jun 24 08:49:54.546537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 337/656] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:54.726525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:54.727127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:54.733056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.733497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.734297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:54.734726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:54.870756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:54.878322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8a3f1f2f-b2e4-44c1-b046-f2d8358e3ebe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.155618 Jun 24 08:49:54.878892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 338/657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:55.565860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.566862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.574488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.574946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.575740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.576180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.714600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.723600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.725094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:55.726354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7ec7279a-d18d-4e74-9dae-030f630b7c87 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.164937 Jun 24 08:49:55.726912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 339/658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:55.895786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:55.896296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:55.902342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.902785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:55.903558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:55.903987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.040037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.047678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-557bb18a-5ab5-4725-bc7d-8ab6628f25ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.156384 Jun 24 08:49:56.048445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 340/659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:55 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:49:56.745070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:56.745768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:56.752199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.752648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.753410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:56.753880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:56.807913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:56.829890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=5 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:56.883830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.892438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.894466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:56.895624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67f32f30-d9a8-448a-9f02-5388c04cbe77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.154539 Jun 24 08:49:56.896189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 341/660] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:57.066716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:57.067316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:57.073403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.073906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.074679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.076152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.213249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:57.220827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62990b24-7fdb-4c40-8878-90ea87a3a4ec tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.158543 Jun 24 08:49:57.221404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 342/661] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:57 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:57.915304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:57.915977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:57.922488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.922940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:57.923717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:57.924807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.060703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:58.069372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:58.070916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:58.072079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e49c1dd5-c758-498c-bd4e-96a05343fd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.161282 Jun 24 08:49:58.072644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 343/662] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:58.238058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:58.238577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:58.244820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.245269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.246099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:58.246527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:58.415358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:58.429529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-771fa08c-8821-41a0-880b-6a2769d9a4e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.195046 Jun 24 08:49:58.430630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 344/663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:49:59.090829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:59.091615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:59.098074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.098520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.099279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.099708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.228736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.237535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.239050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.240212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d3bae240-0165-4d07-a6f3-a2f21d10fdba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.153486 Jun 24 08:49:59.240765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 345/664] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:49:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:49:59.450697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:49:59.451212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:49:59.457126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.457566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.458350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:49:59.458778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:49:59.589866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:49:59.597755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac1e2536-9174-4159-b082-b54af63cb613 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.150997 Jun 24 08:49:59.598306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 346/665] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:49:59 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:00.259097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:00.259787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:00.266743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.267190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.268533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.269287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.402818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.411547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.412968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.414147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56d65ad4-7a7a-4ebd-9d44-38418096a61b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.159169 Jun 24 08:50:00.414708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 347/666] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:00.614881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:00.615482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:00.621476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.621959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.622710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:00.623139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:00.752521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:00.759950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-db2e4dc7-ae3d-419a-ad52-c8cfcc4ac777 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.149363 Jun 24 08:50:00.760511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 348/667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:01.435651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:01.436362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:01.443010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.443462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.444241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.444674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.594667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.596895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:01.604333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.605853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.607137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bbecbbe5-57db-4a20-aac4-2b4013081bbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.176571 Jun 24 08:50:01.607703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 349/668] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:01.777101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:01.777767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:01.784591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.785212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.786531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:01.787111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:01.919423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:01.927396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-70bb64cd-4ff8-4343-922b-0b0d388fc7d5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.154939 Jun 24 08:50:01.928174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 350/669] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:02.629774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:02.645469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:02.653149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.653911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.654864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.655477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.796643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.807151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.809036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:02.810490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9b9e205e-ac82-4142-b8a8-39fd723d939a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.188178 Jun 24 08:50:02.811325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 351/670] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:02.952355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:02.952884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:02.958910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.959357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:02.960120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:02.960553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.094445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.102843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-605c507b-e1e0-4f6c-95bb-b81f396de9ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.154390 Jun 24 08:50:03.103414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 352/671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:02 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:03.829541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:03.830840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:03.837315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.837798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.838573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:03.839006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:03.966466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.974864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.976349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:03.977501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fcdd37b-c59e-4df8-9c4d-c7f76dea7864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.151900 Jun 24 08:50:03.978092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 353/672] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:04.120054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:04.120657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:04.127150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.127603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.128360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:04.128792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:04.260952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:04.268376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dc3ee051-6964-4bb8-9296-34742e4994f4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.152202 Jun 24 08:50:04.268943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 354/673] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:04 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:04.995907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:04.996594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:05.003298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.003743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.004527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.004949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.138704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.148375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.149910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.151153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-422d46fb-20c1-49af-bc2e-9565a564c964 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.159194 Jun 24 08:50:05.151648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 355/674] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:05.285507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:05.286449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:05.293052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.293505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.294358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:05.294792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:05.445440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:05.458839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-721cfe39-a4d1-4742-a09b-6f4b3499daaa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.177290 Jun 24 08:50:05.459914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 356/675] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:06.170296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:06.170934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:06.178223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.178821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.179674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.180246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.309433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.317757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.319285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.320505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bd45c9cd-52db-4b4a-9e2f-8ec7d9560625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.154198 Jun 24 08:50:06.321052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 357/676] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:06.477136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:06.477674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:06.483787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.484226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.484975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:06.485400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:06.615948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:06.623953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ae51015e-2661-41e7-a446-068915797a30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.150740 Jun 24 08:50:06.624519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 358/677] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:07.339007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:07.339723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:07.346704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.347148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.348192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.348627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.486316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.497868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.499578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.501013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d790c05-11fb-4828-a411-8558584029a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.165684 Jun 24 08:50:07.501854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 359/678] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:07.640663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:07.641371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:07.647854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.648308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.649080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:07.649511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:07.790720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:07.798625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f00c0c7c-da59-4331-8c32-41f022f5ddc8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.161749 Jun 24 08:50:07.799775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 360/679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:08.521424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:08.522146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:08.528906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.529355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.530173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.530606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.690347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.712259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.715332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.717541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e9e07b57-1578-4503-b62b-de72798e4a16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.200493 Jun 24 08:50:08.718607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 361/680] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:08.816759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:08.817363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:08.823572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.824020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.824797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:08.825226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:08.973195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:08.981259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3b148b05-3876-4741-8dbb-758e35ab21d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.168928 Jun 24 08:50:08.982133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 362/681] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:08 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:09.738696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:09.739467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:09.747111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:09.747784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:09.748667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:09.749230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:09.908842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:09.918582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:09.920074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:09.921239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-77a91c6b-3e97-4f25-8413-2a7e8a49d06b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.187085 Jun 24 08:50:09.921825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 363/682] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:10.000574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:10.001308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:10.009865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.010324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.011123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.011556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.161338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:10.169107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bb9fdd9c-26d0-4e50-bf54-5fb57f174dc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.174411 Jun 24 08:50:10.169713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 364/683] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:09 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:10.941253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:10.941941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:10.949222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.949693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:10.950473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:10.950902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.142560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.151722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.153243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.154459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7079c819-74f7-482d-87b9-2f54a50cf6d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.217916 Jun 24 08:50:11.155035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 365/684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:11.186542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:11.187151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:11.195374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:11.195960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.196697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:11.197126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:11.213097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:11.336744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:11.344219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d606459c-5eae-4e01-acbc-cd9df1385700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.161649 Jun 24 08:50:11.344780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 366/685] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:12.173044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:12.173754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:12.180805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.181262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.182076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.182515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.312795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.322569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.324053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.325224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b06d0eea-04a9-4e2f-a080-33205a59be6a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.156065 Jun 24 08:50:12.325812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 367/686] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:12.361632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:12.362277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:12.368971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.369420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.370237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:12.370674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:12.517304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:12.524909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e18bcb49-7d9a-4dc3-95ae-f7d42ae7b085 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.167220 Jun 24 08:50:12.525490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 368/687] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:13.344361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:13.345026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:13.351077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:13.351469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:13.352230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:13.352663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:13.479119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:13.488030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:13.489557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:13.490762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4d3dd06c-3e38-469c-a65c-c364adf2f222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.150516 Jun 24 08:50:13.491294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 369/688] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:13.541832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:13.542456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:13.549471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:13.549958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:13.550745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:13.551179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:13.688068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:13.697134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c9c47667-29d0-4b15-92e6-ab858f4b5337 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.159245 Jun 24 08:50:13.697760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 370/689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:13 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:14.509216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:14.509870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:14.516371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:14.516809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.518293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:14.518725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.658476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.667607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.669150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.670405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b49198b8-2f7e-4f28-b792-b27d0d0be858 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.165220 Jun 24 08:50:14.670974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 371/690] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:14.713598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:14.714244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:14.720537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:14.720986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.721795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:14.722235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:14.860441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:14.868977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dd636210-0b17-4630-9caf-3f194dd51724 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.159117 Jun 24 08:50:14.869583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 372/691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:15.690180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:15.690908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:15.697401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.697884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:15.700263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.700713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:15.841561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.851435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.852928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:15.854122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f336179-6df5-4a30-93e1-1dbbd48f490a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.168586 Jun 24 08:50:15.854695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 373/692] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:15.887029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:15.887722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:15.890156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:15.897851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.898516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:15.899734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:15.900369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:16.067775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:16.075665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3c16b406-42d3-4256-b111-762454651415 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.192525 Jun 24 08:50:16.076255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 374/693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:15 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:16.875222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:16.876185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:16.882983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:16.883428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:16.884192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:16.884619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:17.026952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.035972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.037490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.038724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-db46aa71-5986-4322-b4ea-7de6a5f67d3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.167690 Jun 24 08:50:17.039292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 375/694] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:17.093680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:17.094306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:17.100502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:17.100952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:17.101760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:17.102223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:17.249615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:17.258018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8846759e-34af-40a8-b0e1-59944dc70252 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.168172 Jun 24 08:50:17.258584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 376/695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:18.057688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:18.058363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:18.065216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.065677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.066440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.066873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.193691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.202312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.203806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.205599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-04a30ba4-2fe5-42a6-b42b-a9b66e7e79fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.151247 Jun 24 08:50:18.206196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 377/696] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:18.275004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:18.275620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:18.281926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.282465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.283335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:18.283763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:18.420071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:18.428559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3974c3c5-0c0c-4776-aec9-252b44bb08d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157393 Jun 24 08:50:18.429134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 378/697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:19.224749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:19.225587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:19.231960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.232402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:19.233161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.233593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:19.366265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:19.374895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:19.376388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:19.377554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9af382c7-cea8-4b1b-a058-2c8bd8a2095d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.157436 Jun 24 08:50:19.378166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 379/698] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:19.445064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:19.445693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:19.451783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.452228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:19.453001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:19.453435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:19.614346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:19.622187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0cdd4e7b-2111-426f-a888-8c061369321a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.180898 Jun 24 08:50:19.622770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 380/699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:19 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:20.397208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:20.397942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:20.404861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:20.405280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:20.406121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:20.406636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:20.551846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.560706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.562246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.563418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4fa62200-c3ee-46c9-af06-706afe622bce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.170876 Jun 24 08:50:20.563991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 381/700] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:20.639774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:20.640390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:20.647468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:20.647916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:20.648691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:20.649125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:20.795926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:20.803950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67e90cb8-3a2f-42d3-93f9-304237f82bc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.167969 Jun 24 08:50:20.804456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 382/701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:21.582386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:21.583269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:21.589634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.590385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.591162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.591591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.594151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:21.722921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.731507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.733002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.734188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8e59856a-2485-4aa5-95eb-a947690c578e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.156509 Jun 24 08:50:21.734750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 383/702] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:21.821129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:21.821804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:21.828158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.828656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.829513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:21.830802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:21.978733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:21.986861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c6a08224-5a8f-4774-83d3-3f6e4398fdbc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.169928 Jun 24 08:50:21.987456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 384/703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:22.755146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:22.755827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:22.762403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:22.762859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:22.763634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:22.764070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:22.901111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.910682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.912215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:22.913370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-334127fd-88f7-42f5-8e7c-c6cad919cd53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.162217 Jun 24 08:50:22.913965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 385/704] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:23.005010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:23.005609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:23.011677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.012121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:23.012880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.013310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:23.154656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:23.163645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9d7d8534-8bcc-4974-9caa-bb918e2635be tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.162418 Jun 24 08:50:23.164234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 386/705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:22 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:23.932729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:23.933409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:23.942239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.942753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:23.943593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:23.944093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.080809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.089096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.090609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.091750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7d7f957-0ebc-4eb0-90b4-b029362996f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.163796 Jun 24 08:50:24.092310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 387/706] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:24.181525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:24.182171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:24.188466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.188839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.190201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:24.190640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:24.331046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:24.338730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac4909b7-c936-4681-9004-f7156f3cfc1f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.161063 Jun 24 08:50:24.339299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 388/707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:25.109683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:25.110354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:25.117372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.117863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.118616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.119044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.247796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.256188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.257687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.258850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e89aad3e-f8b2-4c8e-9b7f-7f605d74968c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.153082 Jun 24 08:50:25.259436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 389/708] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:25.356218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:25.356822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:25.363656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.364023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.364866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:25.365298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:25.509861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:25.517940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8069ac47-f9f0-4445-be7d-001c45fd5047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.164901 Jun 24 08:50:25.518500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 390/709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:26.277505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:26.278220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:26.285959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.286403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.287177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.287608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.418233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:26.427344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:26.428835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:26.430034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-93af2017-697a-452d-a7b7-19152a50bf8f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.156496 Jun 24 08:50:26.430597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 391/710] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:26.535363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:26.536008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:26.542208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.542659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.543431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:26.543871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:26.685924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:26.693977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-00662ae7-6f92-4856-b2ff-c7993c348020 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.163342 Jun 24 08:50:26.694557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 392/711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:27.448508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:27.449360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:27.457643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.458117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.458888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.459324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.590131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.602725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.604233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.605423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-16780afb-9f44-4e3b-9302-18f3d50f4a93 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.160933 Jun 24 08:50:27.606100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 393/712] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:27.711417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:27.711942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:27.717970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.718419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.719221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:27.719619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:27.856045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:27.863637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eb001e26-a1ed-418c-8ee9-27666565224d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.156145 Jun 24 08:50:27.864220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 394/713] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:28.623885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:28.624522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:28.631078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.631523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.632284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.633062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.761912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.770526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.772305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:28.773465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f2594dc-402d-457e-b769-b6be32539c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.153505 Jun 24 08:50:28.774065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 395/714] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:28.880624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:28.881151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:28.887092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.887547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:28.888311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:28.888743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:29.026012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.034393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-734e0866-adee-497c-a543-818113cefecf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157511 Jun 24 08:50:29.035236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 396/715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:28 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:29.792036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:29.792712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:29.799882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:29.800255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:29.801010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:29.801469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:29.935749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.945005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.946514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:29.947668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-89616487-071b-4af6-a7e8-859aa479cd96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.159547 Jun 24 08:50:29.948222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 397/716] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:30.052135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:30.052656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:30.059031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.059481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:30.060247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.060684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:30.195676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:30.203308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ec4372f7-58dd-4a18-8291-313eaf7030cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.155668 Jun 24 08:50:30.203892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 398/717] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:30.967999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:30.968651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:30.976668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.977122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:30.978086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:30.978739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:31.116122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.118504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:31.126996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.128757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.130036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-160095a0-13c9-4692-9b90-c3ab020e47c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.167598 Jun 24 08:50:31.130679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 399/718] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:31.220871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:31.221421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:31.227981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:31.228464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:31.229245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:31.229715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:31.377235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:31.385242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32f67089-56c7-4303-b707-9df235380d20 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.168937 Jun 24 08:50:31.385873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 400/719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:32.149327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:32.150059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:32.156633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.157073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.157873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.158299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.484816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.494893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.496410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.497608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-721ccda3-2015-4d72-8cbc-5a23507dff6c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.352767 Jun 24 08:50:32.498201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 401/720] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:32.515163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:32.515788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:32.522531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.522992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.523785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:32.524230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:32.690662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:32.698582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0915255a-fec6-4cf5-af3f-72262735e6fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.187494 Jun 24 08:50:32.699162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 402/721] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:33.518594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:33.519483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:33.525594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.526068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.526829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.527267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.660853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:33.675068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:33.677822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:33.679347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-253d0a87-6e3f-4946-9338-d9c7291d70f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.165647 Jun 24 08:50:33.680110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 403/722] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:33.716181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:33.716912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:33.723307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.723757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.724531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:33.724963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:33.867592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:33.875248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-608335d6-a8f6-42b0-bb81-abd3b06dcdcb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.162999 Jun 24 08:50:33.875822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 404/723] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:34.708332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:34.709067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:34.719460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:34.720033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:34.720890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:34.721545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:34.858103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:34.867628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:34.869412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:34.870626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-babdd2c7-799c-4fa6-9543-51fe5bee2d2e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.167105 Jun 24 08:50:34.871178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 405/724] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:34.892436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:34.893034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:34.899355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:34.899797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:34.900597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:34.901034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.048777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:35.057113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-245c750e-7a6f-4b42-afae-467d3e655c6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.168442 Jun 24 08:50:35.057731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 406/725] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:35.889970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:35.890664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:35.898015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.898494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:35.899273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:35.899711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.050058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.063351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.065522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.066989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37f786e4-c18c-4b07-b82b-1f3a2de62650 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.181027 Jun 24 08:50:36.070022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 407/726] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:36.083658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:36.084733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:36.095724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.096544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.097968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:36.098757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:36.269499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:36.278154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5e5ea323-22a1-4dd5-9637-ea57cb9b5cea tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.202431 Jun 24 08:50:36.278759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 408/727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:37.090601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:37.090601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:37.095958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.096408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.097203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.097637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.264342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.278728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.280272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.281473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c958ea9d-fa6a-49eb-b646-1f57e7f122cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.198979 Jun 24 08:50:37.282079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 409/728] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:37.358760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:37.359495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:37.367091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.367537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.368560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:37.369391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:37.533908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:37.542402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-45ee58c6-1558-43ed-b2dd-4e79ed218843 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.187805 Jun 24 08:50:37.543003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 410/729] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:38.302908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:38.303985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:38.310971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.311422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.312217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.312654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.486082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:38.502329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:38.505609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:38.507833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e16294a9-528b-48fb-9b94-e7438ce5f91c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.210440 Jun 24 08:50:38.508823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 411/730] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:38.562967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:38.563680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:38.570862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.571317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.572106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:38.572543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:38.740189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:38.755353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0da62e96-afaa-4a95-ab1a-07891bf1e58a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.196456 Jun 24 08:50:38.756395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 412/731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:39.528783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:39.529633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:39.537442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.537942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.538778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.539219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.731876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:39.742737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:39.744321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:39.745561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c04ddbb7-cc41-411c-95a1-f8d8cd222773 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.221564 Jun 24 08:50:39.746174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 413/732] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:39.777416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:39.778063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:39.785949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.786460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.787391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:39.787926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:39.973099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:39.981410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aff02c65-cf53-44c1-b4cf-1f14202d4003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.209383 Jun 24 08:50:39.982073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 414/733] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:39 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:40.766899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:40.774466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:40.788288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:40.788737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:40.789537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:40.790123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:40.988023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:40.997540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:40.999345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:41.000724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53ef8bff-cabe-426b-b1e2-5419c6b4671f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.238698 Jun 24 08:50:41.001469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 415/734] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:41.007329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:41.008001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:41.014769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.015217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.015992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:41.016426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:41.033355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:41.182485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:41.196089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87c4583b-13e6-48db-9fcb-c400bf5f27c6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.192672 Jun 24 08:50:41.197083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 416/735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:42.027638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:42.028442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:42.036982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.037443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.038324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.038739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.193258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.207666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.210307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.212086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c433a63e-5858-431f-92cc-b229d1bfda2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.192451 Jun 24 08:50:42.212953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 417/736] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:42.220959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:42.221956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:42.232685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.233484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.234923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:42.236229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:42.418856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:42.429285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-355c8349-550e-4b41-bab5-bff8c11fdc4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.214558 Jun 24 08:50:42.429934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 418/737] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:42 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:43.038640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:50:43.039903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:50:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/action (ip 10.222.0.48) !!! Jun 24 08:50:43.231948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:43.232571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:43.239653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.240101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.240874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.241387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.401559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.413707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.415914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.417638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-db18af7a-f0e2-45ff-a8c2-721cde7149ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.189818 Jun 24 08:50:43.418284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 419/738] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:43.448541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:43.449176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:43.456013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.456588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.457459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:43.457997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:43.615653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:43.629033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-68c45e63-79b5-40d0-ae29-17dbef40617e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.183916 Jun 24 08:50:43.630167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 420/739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:44.443685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:44.445217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:44.453458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.454194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.455352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.455876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.636055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:44.645952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:44.648647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:44.649406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0e7facdc-9868-4230-9a76-b4352ed99941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.211282 Jun 24 08:50:44.650040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 421/740] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:44.654831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:44.655456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:44.663083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.663581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.664558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:44.664998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:44.851255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:44.859839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d1317af-e56a-486a-8b9c-9f1526cd1ab2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.208711 Jun 24 08:50:44.860439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 422/741] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:45.676070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:45.676804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:45.686289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.687045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:45.688741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.689365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:45.884884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:45.898100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:45.901076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:45.903231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0fb669b3-55f9-4505-89c9-6337e946eb77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.232354 Jun 24 08:50:45.904187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 423/742] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:45.913113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:45.914243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:45.917337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:45.926171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.926906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:45.928152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:45.929329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:46.112642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:46.120616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f1a3fa1d-55b8-4d2a-aa16-c0de43f01ba0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.215044 Jun 24 08:50:46.121487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 424/743] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Unexpected exception in API method: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 64bc8771cfc2458cae4062fb7abe6ae5 Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 441, in get Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._queues[msg_id].get(block=True, timeout=timeout) Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 322, in get Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return waiter.wait() Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 141, in wait Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return get_hub().switch() Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 313, in switch Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.greenlet.switch() Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _queue.Empty Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:50:46.879354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 50, in get_console_output Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi output = self.compute_api.get_console_output(context, Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4684, in get_console_output Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.compute_rpcapi.get_console_output(context, Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/rpcapi.py", line 805, in get_console_output Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return cctxt.call(ctxt, 'get_console_output', Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi result = self.transport._send( Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._driver.send(target, ctxt, message, Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._send(target, ctxt, message, wait_for_reply, timeout, Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 678, in _send Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi result = self._waiter.wait(msg_id, timeout, Jun 24 08:50:46.881224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in wait Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi message = self.waiters.get(msg_id, timeout=timeout) Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 443, in get Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise oslo_messaging.MessagingTimeout( Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 64bc8771cfc2458cae4062fb7abe6ae5 Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jun 24 08:50:46.882572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: POST /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/action HTTP/1.1 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 27 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 08:50:46.883850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {"os-getConsoleOutput": {}} Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 08:50:46.885454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'e738abd4-3c88-4daf-a1a5-0ff726682731', 'body': {'os-getConsoleOutput': {}}} Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 441, in get Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._queues[msg_id].get(block=True, timeout=timeout) Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 322, in get Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return waiter.wait() Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 141, in wait Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return get_hub().switch() Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 313, in switch Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.greenlet.switch() Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _queue.Empty Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 08:50:46.886462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 50, in get_console_output Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi output = self.compute_api.get_console_output(context, Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4684, in get_console_output Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.compute_rpcapi.get_console_output(context, Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/rpcapi.py", line 805, in get_console_output Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return cctxt.call(ctxt, 'get_console_output', Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 189, in call Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi result = self.transport._send( Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._driver.send(target, ctxt, message, Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._send(target, ctxt, message, wait_for_reply, timeout, Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 678, in _send Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi result = self._waiter.wait(msg_id, timeout, Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in wait Jun 24 08:50:46.887886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi message = self.waiters.get(msg_id, timeout=timeout) Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 443, in get Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise oslo_messaging.MessagingTimeout( Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 64bc8771cfc2458cae4062fb7abe6ae5 Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:50:46.888897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e3f665bf-74d7-4253-a5a0-045cd8704cc9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/action" status: 500 len: 216 microversion: 2.1 time: 60.088353 Jun 24 08:50:46.890359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 320/744] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:49:46 2022] POST /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/action => generated 216 bytes in 60090 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Jun 24 08:50:46.931829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:46.932441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:46.939826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:46.940277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:46.941072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:46.941511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:47.092800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:47.103835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:47.105588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:47.106779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-68a788b8-1f5c-4448-9b25-25a75a742c09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.178928 Jun 24 08:50:47.107356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 425/745] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:47.148556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:47.149617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:47.161256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:47.161726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:47.162520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:47.162959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:47.329843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:47.338414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d375ed81-277b-4f23-b438-96a7fee03c9a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.203482 Jun 24 08:50:47.339006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 321/746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:47 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:48.133233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:48.133862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:48.140733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.141770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.142552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.142985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.291685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:48.300760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:48.302287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:48.303452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48a089b8-a050-42e3-9c9f-6565cf5a8037 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.174154 Jun 24 08:50:48.304005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 426/747] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:48.356174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:48.356802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:48.363954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.364399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.365169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:48.365603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:48.501839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:48.509367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d32c46f0-b4e4-4eec-ada4-c4cabb83434b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157148 Jun 24 08:50:48.509986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 322/748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:49.322585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:49.323222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:49.330273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.330721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.331510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.331930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.467487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:49.476208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:49.477720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:49.478890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a453153f-692d-48d2-9146-85be59f1c501 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.160313 Jun 24 08:50:49.479444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 427/749] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:49.526423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:49.527089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:49.533754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.534473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.535240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:49.535678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:49.669426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:49.678375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a3c69b15-4b25-4810-812b-198612eccbac tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.155419 Jun 24 08:50:49.678711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 323/750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:49 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:50.497839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:50.498429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:50.505397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.505883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.506653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.507088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.639023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:50.647523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:50.649019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:50.650218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7dbef9fc-15eb-4519-b700-3f669a2b802c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.156498 Jun 24 08:50:50.650774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 428/751] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:50.695116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:50.695700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:50.702206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.702645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.703399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:50.703828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:50.833827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:50.841313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-324bafc7-34e6-4dbc-bca9-1a8812c07ce1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.150104 Jun 24 08:50:50.841903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 324/752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:51.669065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:51.669650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:51.676227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.676671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.677431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.677891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.831236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:51.840647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:51.842177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:51.843350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c2bbf92a-3a0d-409c-b6b0-1205d0f4a56f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.178265 Jun 24 08:50:51.843908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 429/753] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:50:51.858713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:51.859525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:51.867281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.867643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.868427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:51.868852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:51.997044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:52.005067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f19c2e13-a4e6-4283-a849-bf51c2051745 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.150882 Jun 24 08:50:52.005630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 325/754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:51 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:50:52.862755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:52.863376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:52.870527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.871114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:52.871932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:52.872370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.023251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:53.023958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:53.024898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:53.033862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:53.034442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:53.034857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.035820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:53.036239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:53.036980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:53.037099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e110c7ee-3827-426f-a437-d6ad463a24ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.179187 Jun 24 08:50:53.037547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 430/755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:53.178001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:53.186420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5db956da-0ddb-4ef6-804c-765fa8ad893f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.167591 Jun 24 08:50:53.187142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 326/756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:54.056431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:54.057030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:54.064093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.064778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.065546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.066128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.202045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.212079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.213583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.214080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:54.214699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:54.214816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3c9af837-6041-4a19-b0e4-183ac804e3a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.162340 Jun 24 08:50:54.215336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 431/757] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:54.221472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.222032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.222875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:54.223306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:54.356306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:54.365092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8ffc4e77-800a-4c3a-b5ae-732e12e5f7a0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.157168 Jun 24 08:50:54.365092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 327/758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:55.233401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:55.234029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:55.241134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.241583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.242382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.242813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.378660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.381972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:55.382784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:55.388089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.389307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.389794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.389984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.390583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:55.391030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:55.391219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40f706cb-989f-47b5-9f32-346fe61881a6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.161599 Jun 24 08:50:55.391814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 432/759] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:55.542287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:55.550696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ed4ebf78-0639-402f-b075-a6efd3fb78c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.173997 Jun 24 08:50:55.551284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 328/760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:55 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:56.411822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.412284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.418968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.419423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.420200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.420634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.423580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:50:56.556946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.565940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.567445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.567716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:56.568336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:56.568617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c2c941e4-b3d7-4bad-b86d-4ce95e354039 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.161829 Jun 24 08:50:56.569181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 433/761] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:56.575036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.575481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.576288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:56.576723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:56.719845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:56.727516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c399cb65-a6a7-441a-ae97-66d59ac268dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.163512 Jun 24 08:50:56.728084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 329/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:56 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:57.587485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.588210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.594686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.595141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.595965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.596396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.731792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.741131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.743085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.744502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cbf85791-f069-4f89-bb4a-db74a70fdbab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.161071 Jun 24 08:50:57.744637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:57.745119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:57.745808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 434/763] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:57.752724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.753171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.753995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:57.754432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:57.902863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:57.911235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e39ed1b7-f7a5-4316-b84f-d05bb1a008f6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.170460 Jun 24 08:50:57.911812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 330/764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:57 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:58.763338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:58.763995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:58.771279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.771721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.772485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.772911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.928825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:58.936074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:58.936938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:58.938257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:58.940409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:58.941623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ffda893c-95fc-45c0-9101-4c510f9400bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.182301 Jun 24 08:50:58.942225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 435/765] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:50:58.948530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.949258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:58.950600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:58.951307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:59.097205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:50:59.105571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee06510f-5ff6-42e1-a478-9bdf9d2ad43c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.176335 Jun 24 08:50:59.106209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 331/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:50:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:50:59.962311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:50:59.962907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:50:59.969495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:59.969976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:50:59.970746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:50:59.971177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.121626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 64bc8771cfc2458cae4062fb7abe6ae5 Jun 24 08:51:00.125513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:00.126167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:00.134478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.134977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.135804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:00.136273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:00.364808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.375505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.377170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.378613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-84a03794-9298-4c65-9d99-384b9cb40578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.420227 Jun 24 08:51:00.379188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 436/767] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:50:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:00.452523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:00.460779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2fd0199e-abe8-456c-b952-0a57f66a114b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.341103 Jun 24 08:51:00.461358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 332/768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:01.397009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:01.397651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:01.404406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.404847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.405614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.406071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.478953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:01.479563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:01.486202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.486651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.487634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:01.488108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:01.584038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.595593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.597248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.598676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-84f51935-6ecd-4b4e-b457-b3bea22c54e3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.205653 Jun 24 08:51:01.599519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 437/769] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:01.647429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:01.655189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6bf4286b-1f35-4f10-b95f-909ecba2de74 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.181213 Jun 24 08:51:01.655761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 333/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:02.617179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:02.617964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:02.625314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.625823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.627220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.627668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.672117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:02.672738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:02.679965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.680419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.681203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:02.681642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:02.814823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.824487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.825950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.827191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-03084689-9ece-4411-8818-f6af50476a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.214041 Jun 24 08:51:02.827946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 438/771] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:02.867345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:02.874876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fc418a5f-6c75-4a05-99ea-d19860b38716 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.206628 Jun 24 08:51:02.875474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 334/772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:02 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:03.847435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.848273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.855111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.855546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.856331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.856759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.892215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:03.892827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:03.899712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.900441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:03.901961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:03.902409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:04.056591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.067093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.069732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.071539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d400f158-f67b-4df9-86c2-ac730e15c821 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.228636 Jun 24 08:51:04.072615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 439/773] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:04.100453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:04.108601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4ac3e231-1ad0-41e3-8a73-be3abe343f6e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.220175 Jun 24 08:51:04.109198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 335/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:03 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:05.090960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.091569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.098474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.098921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.099689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.100117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.126181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:05.127410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:05.134504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.134952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.135731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:05.136165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:05.293001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.303073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.304632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.305889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-28a9f74f-e0e7-44f7-8189-09a47de889e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.218900 Jun 24 08:51:05.306464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 440/775] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:05.329143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:05.337401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2f306367-09c2-49b5-8dd1-5ec2a970198a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.214931 Jun 24 08:51:05.338018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 336/776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:06.327793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:06.328462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:06.336017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.336714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.337599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.338156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.354562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:06.355161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:06.365816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.366271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.367465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:06.367906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:06.393428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:06.549655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.557553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.561494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.563121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:06.564476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-035b2f92-50b0-4f2e-bd4f-0e40ca14d86d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.240744 Jun 24 08:51:06.565024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 441/777] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:06.565699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fc0d1b83-ffa2-4dc4-b660-df5bd8f016b0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.214884 Jun 24 08:51:06.566278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 337/778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:07.083095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-19d10821-0b9e-406a-904d-a9a3be8289f0 req-3cee7c1a-88d6-42a4-9ca4-e2f151b7e479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddcaa83-a766-4122-8923-3bb23b844391", "name": "network-vif-plugged", "status": "completed", "tag": "a335388c-49c2-4c7a-afdc-1bab81d059f5"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:07.097319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-19d10821-0b9e-406a-904d-a9a3be8289f0 req-3cee7c1a-88d6-42a4-9ca4-e2f151b7e479 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.098092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-19d10821-0b9e-406a-904d-a9a3be8289f0 req-3cee7c1a-88d6-42a4-9ca4-e2f151b7e479 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.114266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-19d10821-0b9e-406a-904d-a9a3be8289f0 req-3cee7c1a-88d6-42a4-9ca4-e2f151b7e479 service nova] Creating event network-vif-plugged:a335388c-49c2-4c7a-afdc-1bab81d059f5 for instance 9ddcaa83-a766-4122-8923-3bb23b844391 on hv-cinder-78729 Jun 24 08:51:07.119263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-19d10821-0b9e-406a-904d-a9a3be8289f0 req-3cee7c1a-88d6-42a4-9ca4-e2f151b7e479 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102664 Jun 24 08:51:07.119855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 442/779] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:07.582683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:07.583277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:07.583566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:07.584427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:07.589854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.590299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.590564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.591013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.591117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.591477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.591780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:07.592220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:07.792856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.800311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.801070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cb310de6-a683-49e4-8e3a-d99c34cfe2c5 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.222342 Jun 24 08:51:07.801652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 338/780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:07.809036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.810554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:07.811734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b2939318-461c-4a25-b125-1fe8b323af96 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.232887 Jun 24 08:51:07.812281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 443/781] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:51:08.531172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:08.532157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.539384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.539833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.540633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.541071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.818559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:08.819216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:08.826204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.826717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.827494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:08.828010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:08.994401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.002042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b75b4d2-e13e-4286-aa25-2bd79ff2afc1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.187927 Jun 24 08:51:09.002606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 444/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:08 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:09.007100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:09.007795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:09.020968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.021426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.022280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:09.022717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:09.039364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-91781f9c-a21d-4029-af08-2c8d2ed1850d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/action" status: 200 len: 28678 microversion: 2.1 time: 0.626478 Jun 24 08:51:09.041144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 339/783] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:51:08 2022] POST /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/action => generated 28678 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:51:09.178485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.192030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.193448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:09.194703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac18b1e0-bebe-4674-8f5e-05ccb2d05955 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.191170 Jun 24 08:51:09.195426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 445/784] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:10.021137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:10.021838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:10.028819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.029219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.030024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.030456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.082932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:10.083508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:10.094430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.095922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.096848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.097342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.121332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-73a681f7-01d6-4377-b2bc-e9742a41841f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/ips" status: 200 len: 151 microversion: 2.1 time: 0.143644 Jun 24 08:51:10.121935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 340/785] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 08:51:09 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731/ips => generated 151 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:10.169196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:10.177632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d53b38de-90f5-4529-b039-aa77a455cc53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.160832 Jun 24 08:51:10.178217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 446/786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:10.213788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:10.214424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:10.220402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.220850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.221619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:10.222093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:10.364589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:10.380318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:10.381891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:10.383080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1cb9f97b-c88f-4451-9330-d005f33ba479 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.173318 Jun 24 08:51:10.383810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 341/787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:11.195557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:11.196147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:11.202769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.203210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.203978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.204406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.338701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.346146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5add04f3-482d-43e6-afe9-9db779fdb0db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1264 microversion: 2.1 time: 0.154401 Jun 24 08:51:11.346706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 447/788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:11.401355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:11.401992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:11.408798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.409252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.410080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:11.410520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:11.547681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.557498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.559157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:11.560650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd1f9cc5-3493-4cf4-b1a2-7032d81d6f35 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.162986 Jun 24 08:51:11.561272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 342/789] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:12.363589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:12.364269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:12.370803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.371254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.372020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.372459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.501624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.509860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-24d2372d-566f-4b5d-9855-b7fe4e160712 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1451 microversion: 2.1 time: 0.150849 Jun 24 08:51:12.510429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 448/790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:51:12.526021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:12.526627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:12.534432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.534887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.535663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.536098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.579719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:12.580334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:12.586432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.587076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.587855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:12.588294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:12.724195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.732167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f2ec7b45-51d1-4a83-b495-8be4982fbbdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1451 microversion: 2.1 time: 0.210079 Jun 24 08:51:12.732780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 343/791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:51:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:51:12.752463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.761240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.762773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:12.763937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-82f447bd-7197-486b-a19e-d8902c735a3d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.188222 Jun 24 08:51:12.764495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 449/792] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 08:51:13.349011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-6bac47b0-9056-4eee-9554-2fbbfb343c41 req-f6879a21-c4bb-40ae-8281-b243f1ed07cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "name": "network-vif-plugged", "status": "completed", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:13.358991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6bac47b0-9056-4eee-9554-2fbbfb343c41 req-f6879a21-c4bb-40ae-8281-b243f1ed07cd service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.360076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6bac47b0-9056-4eee-9554-2fbbfb343c41 req-f6879a21-c4bb-40ae-8281-b243f1ed07cd service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.373253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-6bac47b0-9056-4eee-9554-2fbbfb343c41 req-f6879a21-c4bb-40ae-8281-b243f1ed07cd service nova] Creating event network-vif-plugged:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 08:51:13.379185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-6bac47b0-9056-4eee-9554-2fbbfb343c41 req-f6879a21-c4bb-40ae-8281-b243f1ed07cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034738 Jun 24 08:51:13.379860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 344/793] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:13.782717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:13.783686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:13.789868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.790316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.791081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:13.791513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:13.806924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:13.934868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:13.946023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:13.947663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:13.948846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-048c28b8-dd33-4ea5-9f43-8cdf129c0a53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.170430 Jun 24 08:51:13.949407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 450/794] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:14.541449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-402640be-87f4-4339-b9bb-5749e87fea2a req-a03e9106-a015-44a5-a2ce-15580f3741a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ddcaa83-a766-4122-8923-3bb23b844391", "tag": "a335388c-49c2-4c7a-afdc-1bab81d059f5"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:14.550886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-402640be-87f4-4339-b9bb-5749e87fea2a req-a03e9106-a015-44a5-a2ce-15580f3741a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:14.551386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-402640be-87f4-4339-b9bb-5749e87fea2a req-a03e9106-a015-44a5-a2ce-15580f3741a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:14.563261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-402640be-87f4-4339-b9bb-5749e87fea2a req-a03e9106-a015-44a5-a2ce-15580f3741a2 service nova] Creating event network-changed:a335388c-49c2-4c7a-afdc-1bab81d059f5 for instance 9ddcaa83-a766-4122-8923-3bb23b844391 on hv-cinder-78729 Jun 24 08:51:14.567689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-402640be-87f4-4339-b9bb-5749e87fea2a req-a03e9106-a015-44a5-a2ce-15580f3741a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 Jun 24 08:51:14.568936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 345/795] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:14.967827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:14.968631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:14.975624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:14.976023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:14.976879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:14.977324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:15.107694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:15.116143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:15.117645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:15.118831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67fd9b2d-43ce-4d3c-8f74-c12e6a69d833 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.155038 Jun 24 08:51:15.119394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 451/796] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:16.138928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:16.139615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:16.145950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:16.146395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:16.147163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:16.147593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:16.286236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:16.294732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:16.296293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:16.297611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-207ba9ac-e016-4ea9-973a-27cb2837c27d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1808 microversion: 2.20 time: 0.163472 Jun 24 08:51:16.298275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 346/797] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:17.317009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:17.317582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:17.319909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:17.325508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:17.325987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:17.326785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:17.327244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:17.461436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:17.470195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:17.471691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:51:17.472861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-903b847c-8ea9-4eb7-8fd7-cc04faad4148 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1795 microversion: 2.20 time: 0.160378 Jun 24 08:51:17.473417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 452/798] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 08:51:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 08:51:31.420899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=52 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:31.421636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=44 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:31.522717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:31.523737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:31.530125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:31.530576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:31.531349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:31.531784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:31.648565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3e9d062b-4cbb-4c66-b4ad-875c686ae920 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action" status: 200 len: 28722 microversion: 2.1 time: 0.232606 Jun 24 08:51:31.649201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 347/799] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:51:31 2022] POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action => generated 28722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:51:31.675918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2092168659"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:31.676465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:31.679033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:31.679835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=15 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:31.685749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:31.686194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:31.686950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:31.687377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:31.813262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.network.security_group_api [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Removing security group 37ec7606-9a32-4b8b-8f8f-bd3be715a0f5 from port de413bfc-c50c-48a1-8075-b9aa0f5c74d0 Jun 24 08:51:32.163743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f370e1ce-18cb-4a30-96af-53c1115ea2fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action" status: 202 len: 0 microversion: 2.1 time: 0.491663 Jun 24 08:51:32.167379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 453/800] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:51:31 2022] POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:32.174625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-738d83dd-10ea-4c31-98f8-0deaabb8f869 req-7f694aba-350d-4ea0-8cd0-b28b311cc8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:32.183799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-738d83dd-10ea-4c31-98f8-0deaabb8f869 req-7f694aba-350d-4ea0-8cd0-b28b311cc8b8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:32.184245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-738d83dd-10ea-4c31-98f8-0deaabb8f869 req-7f694aba-350d-4ea0-8cd0-b28b311cc8b8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:32.207940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-738d83dd-10ea-4c31-98f8-0deaabb8f869 req-7f694aba-350d-4ea0-8cd0-b28b311cc8b8 service nova] Creating event network-changed:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:51:32.217852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-738d83dd-10ea-4c31-98f8-0deaabb8f869 req-7f694aba-350d-4ea0-8cd0-b28b311cc8b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047082 Jun 24 08:51:32.218649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 348/801] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:33.369516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:33.370061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:33.376173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:33.376620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:33.377389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:33.377855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:33.463967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:51:33.547462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-65d0b53f-7879-4ea4-a60e-ca82d5893914 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 202 len: 0 microversion: 2.1 time: 0.182310 Jun 24 08:51:33.548510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 454/802] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 08:51:33 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:51:33.558669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:33.559769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:33.566956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:33.567406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:33.568378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:33.568807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:33.601477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5c4ec6fb-d8f0-4c7a-bbff-db42545ba2f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047508 Jun 24 08:51:33.602117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 349/803] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:34.233872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-e439dad3-04a3-4c07-8c90-20b686758b40 req-148aabeb-1b36-4714-be86-50b080a4b8a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:34.242870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-e439dad3-04a3-4c07-8c90-20b686758b40 req-148aabeb-1b36-4714-be86-50b080a4b8a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:34.243308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-e439dad3-04a3-4c07-8c90-20b686758b40 req-148aabeb-1b36-4714-be86-50b080a4b8a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:34.254629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-e439dad3-04a3-4c07-8c90-20b686758b40 req-148aabeb-1b36-4714-be86-50b080a4b8a2 service nova] Creating event network-changed:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 08:51:34.259750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-e439dad3-04a3-4c07-8c90-20b686758b40 req-148aabeb-1b36-4714-be86-50b080a4b8a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030041 Jun 24 08:51:34.260374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 455/804] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:34.612830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:34.614012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:34.620617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:34.621085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:34.621893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:34.622387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:34.652718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98417680-850b-4031-ac9f-3d07824a59a3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 Jun 24 08:51:34.653573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 350/805] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:35.665753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:35.666714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:35.672954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:35.673393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:35.674177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:35.674605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:35.703611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18995270-6037-42cf-af77-adf4b153527b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042691 Jun 24 08:51:35.704167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 456/806] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:36.715134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:36.716085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:36.722777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:36.723229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:36.724033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:36.724468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:36.752314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bc5200fd-a90c-404a-8ffd-1a232d134478 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041080 Jun 24 08:51:36.752861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 351/807] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:37.764343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:37.765260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:37.772173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.772616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.773367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:37.773824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:37.804071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d22fcadd-2101-4548-a7cb-d4227ca85412 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Jun 24 08:51:37.804544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 457/808] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:38.815424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:38.816916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:38.823295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:38.823741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:38.824503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:38.824934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:38.853048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bfa8d262-23c9-4e1e-9712-e2f50dccf961 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Jun 24 08:51:38.853613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 352/809] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:39.865328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:39.866206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:39.873012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:39.873457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:39.874271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:39.874709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:39.906832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5814778b-37bb-470f-89d6-4ea6e9e22d9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046004 Jun 24 08:51:39.907690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 458/810] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:40.918583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:40.919725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:40.927760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:40.928219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:40.929002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:40.929432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:40.962306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b774cf39-9627-4a32-910b-be3500427979 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Jun 24 08:51:40.962886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 353/811] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:41.974517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:41.975440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:41.982014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:41.982463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:41.983226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:41.983662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:42.012264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ddf524ed-32ae-4e78-a3e0-71018372b014 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042227 Jun 24 08:51:42.012831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 459/812] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:43.023993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:43.024928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:43.031719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.032165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.033207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:43.033885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:43.063140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a9529931-2359-487a-80af-50c83fb43094 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043062 Jun 24 08:51:43.063712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 354/813] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:44.074874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:44.075788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:44.082266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.082711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.083468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:44.083894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:44.113625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-972682d7-3c2e-458b-b0f4-55dd8a1b0bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Jun 24 08:51:44.114213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 460/814] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:45.125567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:45.126524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:45.133586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:45.134068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:45.134830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:45.135259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:45.165236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6c5e369a-8f76-4d66-addf-4d20da7804fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Jun 24 08:51:45.165846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 355/815] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:46.177068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:46.178055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:46.184591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:46.185040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:46.185841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:46.186279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:46.216186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4579f009-cc63-48ee-a070-24de4e2aeabb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043090 Jun 24 08:51:46.216757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 461/816] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:47.228531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:47.229466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:47.235965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:47.236414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:47.237178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:47.238278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:47.272994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78cb81c7-55c2-464a-826c-44315d58e07a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048422 Jun 24 08:51:47.273564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 356/817] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:48.285561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:48.286562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:48.293366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:48.293865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:48.294648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:48.295082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:48.326968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-22864a81-051c-49b6-a53c-1f512c12f0b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045699 Jun 24 08:51:48.327552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 462/818] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:49.338696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:49.339656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:49.346108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:49.346559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:49.347332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:49.347767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:49.375095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5739ba66-bca7-4e5c-a074-52142e64e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040417 Jun 24 08:51:49.375679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 357/819] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:50.388437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:50.389476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:50.396274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:50.396720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:50.397479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:50.397935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:50.428384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0b73f9d7-b79b-41ca-bd3a-54d342a7f5b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 Jun 24 08:51:50.428936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 463/820] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:51.440230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:51.441187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:51.448055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:51.448534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:51.449312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:51.449787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:51.480307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10f679f1-965f-4c98-a93b-707876fe8a5e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jun 24 08:51:51.480899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 358/821] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:52.492002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:52.492910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:52.499457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:52.499904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:52.500653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:52.501079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:52.529791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-36c7ad37-b790-4ac9-95aa-2b2af09b7154 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041810 Jun 24 08:51:52.530352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 464/822] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:53.542023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:53.542949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:53.549444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:53.549919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:53.550688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:53.551125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:53.580282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8038dcc7-baa3-45c4-aa24-e46f97ef9a84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 Jun 24 08:51:53.580835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 359/823] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:54.591647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:54.592566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:54.599340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:54.599788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:54.600560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:54.600991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:54.631110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4e280a76-d9da-4696-a0ba-f31e4a80c424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043396 Jun 24 08:51:54.632183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 465/824] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:51:55.643412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:55.644350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:55.651655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:55.652109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:55.652893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:55.653329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:55.684681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7681b79-37a4-48fc-ba9f-1d482ffbe3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Jun 24 08:51:55.685267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 360/825] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:56.697512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:56.698401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:56.705110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:56.705551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:56.706343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:56.706774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:56.737035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1c6bfdbf-c203-4a50-a62c-947db642ee12 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Jun 24 08:51:56.737603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 466/826] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:57.502585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "259fa947-ecb7-4d3d-8a1a-ca3befda6667"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:51:57.503583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:57.511103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.511546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.512332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.512768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.748726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:57.749998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:57.757054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.757380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.758242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:57.758713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:57.792688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3f44d459-d96b-4fce-8a1a-8c4c59c789ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Jun 24 08:51:57.793289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 467/827] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:57.883497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f0e2ae16-ff1b-47b6-abc5-65b2e2d4127d tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "POST /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385477 Jun 24 08:51:57.884471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 361/828] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 08:51:57 2022] POST /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:58.804660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:58.805586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:58.812561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:58.813004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:58.814275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:58.814711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:58.845233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-49542dca-db40-43f6-aef6-1e0b5057270b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Jun 24 08:51:58.845839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 468/829] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:51:59.858828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:51:59.859837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:51:59.866747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:59.867131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:59.867902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:51:59.868339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:51:59.898104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09c45721-ba69-4f36-848b-6b5b75dc9f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Jun 24 08:51:59.898685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 362/830] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:51:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:00.910586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:00.911551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:00.918780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.919229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.920010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:00.920442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:00.947669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:00.953489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aab5b8ba-a884-4b77-bde4-8b3640f0b1d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 Jun 24 08:52:00.954100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 469/831] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:01.967368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:01.968437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:01.970910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=33 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:01.976267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.976717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.977490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:01.978110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:01.980929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:02.010342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-16c2a93f-f526-4722-b975-d26200fc6dd4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Jun 24 08:52:02.010935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 363/832] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:03.022108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:03.023043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:03.026429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=35 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:03.032712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:03.033161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:03.034009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:03.034455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:03.066239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-180e4871-7390-453c-bf7d-a9b9db878b88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047972 Jun 24 08:52:03.067070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 470/833] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:04.080383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:04.081362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:04.090655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.091134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.092000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:04.092440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:04.123975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1b2cc413-6952-457b-a4e2-70c580bc5b52 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047681 Jun 24 08:52:04.124569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 364/834] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:05.136271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:05.137220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:05.143977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.144504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.145195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:05.145684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:05.175477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f05e0818-feca-4681-b903-cec5d4980532 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Jun 24 08:52:05.176053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 471/835] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:06.187332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:06.188192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:06.195383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:06.195832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:06.196605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:06.197042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:06.225404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8ec5515c-86b7-4a0c-b463-dbd95bf1e495 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Jun 24 08:52:06.226156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 365/836] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:07.240129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:07.241067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:07.251902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.252600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.253999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:07.254749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:07.294836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e9d0a2cf-36a1-46d3-8831-ccfeebcb5f70 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059025 Jun 24 08:52:07.295580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 472/837] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:08.307944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:08.308892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:08.315683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.316139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.316929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:08.317362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:08.353604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-28d10562-9a3d-47e0-b34f-a5ce234251ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Jun 24 08:52:08.354220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 366/838] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:09.364939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:09.365944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:09.372595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.373049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.373925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:09.374306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:09.404374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f1fc497b-375d-4913-bcc7-99b03bdb3725 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Jun 24 08:52:09.404952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 473/839] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:10.416292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:10.417223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:10.423670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:10.424113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:10.424876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:10.425320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:10.455289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e165c419-40c9-4ab8-a952-45662727173a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jun 24 08:52:10.455857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 367/840] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:11.188648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:52:11.189305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 08:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:52:11.467519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:11.468425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:11.474936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:11.475384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:11.476144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:11.476606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:11.505590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e2ce2475-9e37-4323-8eba-d141928e5039 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042084 Jun 24 08:52:11.506170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 474/841] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:12.517693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:12.518645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:12.525896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.526361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:12.527130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:12.527570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:12.558344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2207cc07-509f-4c3f-bb4f-a9ab59d0a3f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Jun 24 08:52:12.558916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 368/842] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:13.570263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:13.571765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:13.578075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:13.578518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:13.579272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:13.579700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:13.607284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71997ee6-9eca-4c07-a822-36db7198370e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Jun 24 08:52:13.607837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 475/843] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:14.619136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:14.620095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:14.626560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.627007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.627761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:14.628212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:14.657069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a403c1cd-9507-428c-b0b7-4c47d4561ddd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042081 Jun 24 08:52:14.657550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 369/844] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:15.669120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:15.670061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:15.676922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.677363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:15.678173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:15.678597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:15.708324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c715ebd6-298d-4191-9c9f-c61b7b41fcb3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Jun 24 08:52:15.708884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 476/845] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:16.720478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:16.721343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:16.729171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:16.729623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:16.730486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:16.730928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:16.764076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-90056bf3-4e9f-4912-912b-09dec711b0f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047665 Jun 24 08:52:16.764713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 370/846] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:17.777818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:17.778755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:17.786716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.787209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.788094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:17.788572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:17.822408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01455f06-e99e-47b8-9f1d-bd3e9af4bf65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049254 Jun 24 08:52:17.822982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 477/847] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:18.834740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:18.835679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:18.842332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.842782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.843558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:18.843992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:18.875611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d324423f-726c-4384-80b9-e5acd07bcbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044919 Jun 24 08:52:18.876190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 371/848] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:19.888348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:19.889265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:19.896084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.896531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.897305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:19.897773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:19.931136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71fd0f77-6b5a-4c67-9545-8bb7bbdcecb1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047290 Jun 24 08:52:19.931785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 478/849] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:20.942942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:20.943896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:20.950376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.950822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:20.951614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:20.952044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:20.980276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4a8769d8-dd96-412a-95b8-17da4a6b1041 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041229 Jun 24 08:52:20.980833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 372/850] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:21.992243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:21.993322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:22.000236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.000680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:22.001468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:22.001938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:22.036252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c546cf6b-1889-4fed-8838-c238546c88d0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047919 Jun 24 08:52:22.036825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 479/851] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:23.049307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:23.050603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:23.058098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:23.058543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:23.059346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:23.059785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:23.092590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5ac61179-6f6f-4ff2-aa70-ceeb5709ed19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047042 Jun 24 08:52:23.093198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 373/852] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:23.704255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:52:23.704876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 08:52:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:52:24.106521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:24.107482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:24.114427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.114868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.115637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:24.116067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:24.149848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5e5af80-cb2a-45fa-93b9-31d7625a6ab5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047929 Jun 24 08:52:24.150497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 480/853] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:25.162050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:25.162988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:25.170338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.170780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.171550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:25.171981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:25.203887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8a608027-1e21-4b24-a2f4-cd4bbe5ee05a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Jun 24 08:52:25.204479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 374/854] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:26.216551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:26.217514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:26.224703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:26.225169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:26.226509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:26.226509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:26.262613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7be49790-2066-4101-a2c7-1fb973fbb3d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050144 Jun 24 08:52:26.263851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 481/855] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:27.278630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:27.279644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:27.287460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:27.289782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:27.289782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:27.289782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:27.322844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-930a3253-33a5-4322-a647-8c55e91a1a3a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051458 Jun 24 08:52:27.323402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 375/856] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:28.094058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:52:28.094357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:52:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:52:28.335212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:28.336742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:28.343777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:28.344277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:28.345008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:28.345443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:28.377175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b1f19d9f-7f39-41d5-bd27-e51c7f826298 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Jun 24 08:52:28.377751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 482/857] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:29.389328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:29.390174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:29.396640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:29.397083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:29.397991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:29.398466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:29.429811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-81d8b53a-d7cb-444c-8fd8-d710c29d97b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Jun 24 08:52:29.430409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 376/858] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:30.442678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:30.443618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:30.451181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:30.451623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:30.452397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:30.452827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:30.485699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33d8ada6-ed8e-4fee-b6ff-5976d1e6c908 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Jun 24 08:52:30.486289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 483/859] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:31.496548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:31.497459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:31.503982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:31.504420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:31.505185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:31.505615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:31.536246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-75dd7296-26c4-4839-9b0e-9ebb077d4785 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043537 Jun 24 08:52:31.536834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 377/860] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:32.548112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:32.549048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:32.556422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:32.556886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:32.557704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:32.558141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:32.589383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fd66465-f080-428e-ae1c-14455e531f21 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Jun 24 08:52:32.589932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 484/861] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:33.600919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:33.601915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:33.604373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=30 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:33.609962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:33.610412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:33.611204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:33.611638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:33.614858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=90 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:33.645240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1b68212a-b333-4a69-9584-a9019be08e2b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048255 Jun 24 08:52:33.645729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 378/862] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:34.657043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:34.658210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:34.660690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=30 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:34.666618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:34.667092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:34.667869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:34.668304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:34.671411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=91 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:34.705732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fba0854-89bd-48a3-860d-845ef8903028 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052937 Jun 24 08:52:34.706347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 485/863] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:35.718305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:35.719576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:35.726650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:35.727097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:35.727888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:35.728320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:35.760283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ca8977cb-a28e-4e6d-bbca-fc191123eb58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Jun 24 08:52:35.760779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 379/864] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:36.772382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:36.773316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:36.780334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:36.781061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:36.781919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:36.782386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:36.813454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e2a93192-9a91-4dda-8e6a-d7487bccbd25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Jun 24 08:52:36.814044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 486/865] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:37.826072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:37.827000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:37.834177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:37.834621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:37.835388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:37.835934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:37.870108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5da7eaea-9400-41c2-818a-bdee682ff5c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048356 Jun 24 08:52:37.870607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 380/866] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:38.882215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:38.883164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:38.889709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:38.890158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:38.890920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:38.891347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:38.921009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cbb491d-67b8-4c7b-8cd6-c5014735add6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Jun 24 08:52:38.921509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 487/867] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:39.933062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:39.933946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:39.940733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:39.941184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:39.942009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:39.942441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:39.975404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3a28ada7-92b3-4df3-a83b-5e6635f6e4b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046190 Jun 24 08:52:39.976508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 381/868] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:40.989890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:40.991950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:40.998006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:40.998453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:40.999217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:40.999651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:41.030911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a1b80ce-af78-47ee-a47a-31e2f0b0824d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 Jun 24 08:52:41.031540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 488/869] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:42.043173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:42.044112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:42.051291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:42.051776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:42.052590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:42.053061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:42.087284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bf3cd2bc-0c04-4dbc-a2d9-a4c01f97c103 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Jun 24 08:52:42.087766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 382/870] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:43.099362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:43.100993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:43.107414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:43.107781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:43.108583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:43.109014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:43.139214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d4db4c8f-8f12-4637-b98a-e1310b0f6722 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Jun 24 08:52:43.139775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 489/871] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:44.151498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:44.152461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:44.158815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:44.159264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:44.160045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:44.160478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:44.192290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ad6e9b5-27cd-4c5a-924e-e9ab87b225de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045291 Jun 24 08:52:44.192741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 383/872] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:45.203551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:45.204475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:45.211252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:45.211698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:45.212459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:45.212915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:45.247661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-04632666-e4e1-40fb-9cf1-5f008c040098 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Jun 24 08:52:45.248244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 490/873] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:46.259596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:46.260434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:46.268045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:46.268617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:46.269390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:46.269978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:46.302178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-30bddd61-3cb0-4a11-88a2-8b63f3b18971 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047491 Jun 24 08:52:46.302742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 384/874] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:47.313828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:47.314768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:47.321404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:47.321820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:47.322581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:47.323014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:47.352922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56bdd9b8-b867-489c-9e1a-6a22e9f9775e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Jun 24 08:52:47.353481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 491/875] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:48.365371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:48.366316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:48.372845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.373216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.374008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.374439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.404814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4bfa713a-79b9-4507-aaa0-09fa7f128238 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043911 Jun 24 08:52:48.405674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 385/876] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:52:48.463564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:48.464148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:48.471481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.472047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.472871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.473302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.504797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c667bd97-62e1-4379-ba7f-c2d2e69ed1fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments/5a6a60d3-9943-4f53-9f4d-b6b0de058fb2" status: 200 len: 194 microversion: 2.20 time: 0.046105 Jun 24 08:52:48.505380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 492/877] 10.222.0.48 () {60 vars in 1453 bytes} [Fri Jun 24 08:52:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments/5a6a60d3-9943-4f53-9f4d-b6b0de058fb2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:48.575318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:48.575808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:48.581863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.582317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.583088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.583529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.707436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lazy-loading 'services' on Instance uuid 6cb66bde-d133-41de-b6dd-295b0676be9e {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:52:48.817089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fb1aa0ea-caa6-490d-8ffe-85cd8c97c124 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments/5a6a60d3-9943-4f53-9f4d-b6b0de058fb2" status: 202 len: 0 microversion: 2.20 time: 0.246084 Jun 24 08:52:48.817790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 386/878] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 24 08:52:48 2022] DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments/5a6a60d3-9943-4f53-9f4d-b6b0de058fb2 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:52:48.826742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:48.827674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:48.833608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.834252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.835070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:48.835509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:48.864577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7d133688-e8f0-4798-9f97-c9e5be7dca27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041715 Jun 24 08:52:48.865495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 493/879] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:49.418923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:49.419998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:49.426688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:49.427074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:49.427847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:49.428276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:49.458083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-61033ca2-9a25-4e79-97ee-ad0987e7eb5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jun 24 08:52:49.458680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 387/880] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:49.876638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:49.877593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:49.884634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:49.885079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:49.885881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:49.886314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:49.915516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-28e9714a-bd27-469c-be74-fb99cb862f3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042921 Jun 24 08:52:49.916067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 494/881] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:50.469974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:50.470829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:50.477254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:50.477727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:50.478499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:50.478935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:50.507596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cee0ea71-5b9c-4476-9b9a-2812fb23962b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041609 Jun 24 08:52:50.508169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 388/882] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:50.927496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:50.928414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:50.935590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:50.936043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:50.936801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:50.937233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:50.965650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3a91cff2-040d-4ff1-bb68-f63dd0181dab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042167 Jun 24 08:52:50.966232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 495/883] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:51.519752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:51.520717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:51.527414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:51.527857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:51.528613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:51.529365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:51.562580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-67019bce-3033-4736-8515-89da730b7ddb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Jun 24 08:52:51.563142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 389/884] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:51.986096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:51.987011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:51.993496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:51.993973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:51.994736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:51.995168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:52.025167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c701a4d2-0574-455b-a159-c737f8c6e87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043232 Jun 24 08:52:52.025765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 496/885] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:52:52.574873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:52.575712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:52.582120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:52.582563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:52.583318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:52.583743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:52.611471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ca66f993-5cc4-4552-bb2a-d5f3633f03b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041178 Jun 24 08:52:52.612281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 390/886] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:53.038015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:53.039556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:53.046919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:53.047516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:53.048303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:53.048747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:53.079988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a6dcab17-bfa3-4b75-91ab-7bf3157f319f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046114 Jun 24 08:52:53.080550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 497/887] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:53.623688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:53.624644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:53.631769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:53.632292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:53.633445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:53.634417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:53.663493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7241f243-486e-446f-9bbd-1f7da81ad863 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Jun 24 08:52:53.664042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 391/888] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:54.092203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:54.093123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:54.099934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:54.100382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:54.101148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:54.101583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:54.131074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-42c17da8-8f1e-4404-8ec1-3af7be76f514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042892 Jun 24 08:52:54.131632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 498/889] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:52:54.675297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:54.676147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:54.682939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:54.683391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:54.684158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:54.684586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:54.716001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-30c7cc9a-763b-4fed-9543-48a1bd35f9d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Jun 24 08:52:54.716573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 392/890] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:55.143114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:55.144036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:55.151142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:55.151585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:55.152353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:55.152786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:55.181868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e25b086-b08c-4041-b801-8b7639b52314 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 Jun 24 08:52:55.182418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 499/891] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:55.726910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:55.727780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:55.734181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:55.734620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:55.735376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:55.735804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:55.767589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ee3f688-8a64-494b-99a6-4b8099ed80bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jun 24 08:52:55.768146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 393/892] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:56.194038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:56.195134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:56.201997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:56.202450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:56.203224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:56.203661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:56.233067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e8f02956-7ca5-4ff9-a724-73195f77fd94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043413 Jun 24 08:52:56.233618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 500/893] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:56.780888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:56.781902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:56.789911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:56.790363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:56.791132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:56.791561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:56.794375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:56.821184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7601bf09-a788-4651-8133-b075a96f54eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045539 Jun 24 08:52:56.821756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 394/894] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:57.245597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:57.246531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:57.253563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:57.254044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:57.254821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:57.255259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:57.281679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:57.288897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46f06954-20e7-44a4-832e-a7ee2eb86bba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047868 Jun 24 08:52:57.289486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 501/895] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:52:57.833320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:57.834251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:57.842060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:57.842655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:57.843530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:57.844139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:57.874718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-49844b3f-c2f7-4e49-8d7e-e3ae0a4a1117 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Jun 24 08:52:57.875285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 395/896] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:58.301462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:58.302446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:58.309036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:58.309496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:58.310305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:58.310741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:58.341922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fdcf04f4-be92-45ac-87b5-77b3ea1c2059 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044458 Jun 24 08:52:58.342487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 502/897] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:52:58.887348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:58.888288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:58.895127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:58.895585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:58.896371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:58.896808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:58.928932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f1d2584c-c89c-4174-8846-1a4a0c35b522 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Jun 24 08:52:58.929531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 396/898] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:52:59.353556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:59.354514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:59.361049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:59.361498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:59.362311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:59.362746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:59.395340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f23d159b-9ce8-4a2b-8645-b774034bf90b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045645 Jun 24 08:52:59.395922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 503/899] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:52:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:52:59.941188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:52:59.942059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:52:59.948877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:59.949321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:59.950127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:52:59.950587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:52:59.980920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-52f8d9c7-2c52-49ae-a9ce-1133988e83f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Jun 24 08:52:59.981490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 397/900] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:52:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:00.409044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:00.410004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:00.416744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:00.417183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:00.417985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:00.418416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:00.449592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e5372798-6550-4197-8cf1-aa0c24b4246f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045123 Jun 24 08:53:00.450202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 504/901] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:00.992679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:00.993541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:01.000078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:01.000542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:01.001340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:01.001799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:01.032310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34dff5b4-3692-45b0-b511-4d56f00c2e9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 Jun 24 08:53:01.032886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 398/902] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:01.462934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:01.463954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:01.470652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:01.471099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:01.471871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:01.472457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:01.504381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2cb91988-c5d4-46ec-af91-31fbc5b68d16 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045632 Jun 24 08:53:01.505084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 505/903] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:02.044574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:02.045495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:02.052408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.052856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.053623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.054083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.083723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-68d207c0-786b-4f4c-be83-d9c525c9aa87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043085 Jun 24 08:53:02.084283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 399/904] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:02.517221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:02.518181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:02.525114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.525588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.526416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:02.526849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:02.558942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-693b383f-1a3c-42d3-b9ac-a8fc3e105724 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045643 Jun 24 08:53:02.559505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 506/905] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:03.095665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:03.096503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:03.103443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.104453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.105235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.105693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.135274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a01dff60-d915-4730-9966-0dda604407fb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Jun 24 08:53:03.135840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 400/906] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:03.571569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:03.572480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:03.579214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.579658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.580425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:03.580851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:03.611371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-905f5df4-d8d2-40d0-a564-eec3874c1e5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043906 Jun 24 08:53:03.612388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 507/907] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:04.147047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:04.147919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:04.150261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=46 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:04.156728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:04.157172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:04.158100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:04.158530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:04.188124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-989ef552-cc6c-4941-a51d-862805d6cd03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Jun 24 08:53:04.188685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 401/908] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:04.623203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:04.624139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:04.630747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:04.631199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:04.631979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:04.632413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:04.663698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-83c4aab6-8505-40f2-a096-26c4b8b7c1cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045548 Jun 24 08:53:04.664266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 508/909] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:05.200368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:05.201227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:05.207934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.208385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.209162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.209595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.240430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-02bdafa9-83bd-4f6c-8804-d248500968f6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Jun 24 08:53:05.241006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 402/910] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:05.675390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:05.676309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:05.678705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=48 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:05.683843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.684288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.685053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:05.685483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:05.715805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46af97bb-10c6-423b-843c-b00735b68aff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044376 Jun 24 08:53:05.716566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 509/911] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:06.252051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:06.252884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:06.259289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.259730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.261149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.261577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.290034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-47717303-7e91-491c-a16e-2f4c0018d4b4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041918 Jun 24 08:53:06.290602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 403/912] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:06.727760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:06.729483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:06.736105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.736547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.737310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:06.737769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:06.766165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-812c499a-5b95-4533-b760-3b7f70a1bd50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042351 Jun 24 08:53:06.766715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 510/913] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:07.302434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:07.303357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:07.310075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:07.310524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:07.311289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:07.311723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:07.342111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8a123c94-1a4b-49fe-a1db-2cb95cff0f61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Jun 24 08:53:07.342675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 404/914] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:07.778259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:07.779192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:07.785974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:07.786425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:07.787190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:07.787632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:07.818309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-16513fb1-002e-44a7-b898-ab612957d12b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043928 Jun 24 08:53:07.818878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 511/915] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:08.354944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:08.355841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:08.362650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:08.363099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:08.363885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:08.364327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:08.394914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6aa51c98-55d8-440e-98a4-cedd9e03d905 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044644 Jun 24 08:53:08.395517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 405/916] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:08.830542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:08.831443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:08.837898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:08.838986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:08.839735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:08.840161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:08.868503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-663338a3-4f9a-4f98-acdf-9e05ee1e4d37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042325 Jun 24 08:53:08.868974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 512/917] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:09.406964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:09.407807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:09.414407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.414853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.415627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.416757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.446028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3925d419-a3a3-4091-96cf-e1e713c558db tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Jun 24 08:53:09.446595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 406/918] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:09.880542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:09.881472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:09.888092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.888538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.889307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:09.889777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:09.921900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-036b4774-5edf-49bc-ae00-13a6cb7047f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045614 Jun 24 08:53:09.922478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 513/919] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:10.457979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:10.459088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:10.466433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.466883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.467778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.468320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.500029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9e744aa6-a8be-4817-be50-ec1f078bd354 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Jun 24 08:53:10.500602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 407/920] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:10.933689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:10.934621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:10.942593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.943045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.943867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:10.944308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:10.975579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c4f9fb04-9708-48e3-91c2-91583b714a1e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046465 Jun 24 08:53:10.976133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 514/921] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:11.512339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:11.513267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:11.519923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.520364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.521132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.521640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.559906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8066d751-fcf0-47cf-861f-0c1dad5e3667 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051807 Jun 24 08:53:11.560663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 408/922] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:11.987919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:11.988827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:11.995816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.996261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:11.997020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:11.997448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:12.027643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-57e14275-2bc5-4c6c-afe8-e794245cbb4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043719 Jun 24 08:53:12.028214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 515/923] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:12.571926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:12.572955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:12.579460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:12.579898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:12.580669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:12.581099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:12.610690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96b7eb6f-ad32-4ba0-962a-db812eb97452 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042621 Jun 24 08:53:12.611271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 409/924] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:13.039715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:13.044904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:13.047459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.047901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.048668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.049101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.080576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e12f8bb3-a80d-4537-bc71-f069756bfed6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044778 Jun 24 08:53:13.081354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 516/925] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:13.622518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:13.623452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:13.630611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.631059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.631828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:13.632258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:13.658235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:13.663763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-774dc3f5-fcb2-47a6-ac8b-e5024f7e8bb8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045389 Jun 24 08:53:13.664334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 410/926] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:14.080330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:14.080860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:14.087136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.087579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.089058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.089555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.096747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:14.097802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:14.104682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.105136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.105981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.106447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.114164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lazy-loading 'flavor' on Instance uuid 7e118725-8e5e-42b3-b0be-418687f3e04c {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:53:14.142563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ceca0c38-ab63-4673-ba29-4dabb29a9371 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049640 Jun 24 08:53:14.143196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 411/927] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:14.146383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:14.199375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-10522c78-02c7-48d0-b609-6f286a062167 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "POST /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c/action" status: 202 len: 0 microversion: 2.1 time: 0.231879 Jun 24 08:53:14.200149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 517/928] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:53:13 2022] POST /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 08:53:14.212489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:14.213697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:14.222740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.223109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.223948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.224508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.364525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:14.373030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9d012fae-efde-489e-9dcc-ba91907ba771 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.167780 Jun 24 08:53:14.373617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 412/929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:14.677479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:14.678642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:14.685835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.686317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.687094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:14.687768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:14.718110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-97fa2149-0bd7-48a5-9124-218cf1d70978 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Jun 24 08:53:14.718687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 518/930] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:15.156036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:15.157002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:15.163632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.164082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.164861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.165299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.196078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4d99b8fc-4381-4757-881a-37d733137f7a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Jun 24 08:53:15.196764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 413/931] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:15.391550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:15.392100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:15.398741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.399192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.399969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.401002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.536034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:15.544343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2f9a582-870c-49b4-84dd-a386b9271571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156829 Jun 24 08:53:15.544918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 519/932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:15.730657 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:15.731487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:15.738068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.738513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.739278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:15.739716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:15.768573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a2ff8a51-d609-4983-bfce-ea9d784f90bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042488 Jun 24 08:53:15.769142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 414/933] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:16.209486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:16.210440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:16.219209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.220078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.220850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.221278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.251410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8d0b14bf-7808-4042-89e5-d9f1c9f5ac12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047155 Jun 24 08:53:16.251974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 520/934] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:16.561896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:16.562537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:16.569255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.569718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.570490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.570924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.719811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:16.727875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e23ebeac-a3eb-4670-894b-d09b62dc52ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.170127 Jun 24 08:53:16.728561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 415/935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:16.780147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:16.781079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:16.787745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.788195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.788965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:16.789433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:16.821635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18a930cc-9e54-4cf7-8b25-b11ccb19470a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Jun 24 08:53:16.822736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 521/936] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:17.263929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:17.264842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:17.271154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.271606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.272377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.272811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.301935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e59a6e0c-7f9e-459a-9c5a-fbe8def29c94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042609 Jun 24 08:53:17.302484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 416/937] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:17.746508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:17.747118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:17.753121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.753505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.754296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.754726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.833522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:17.834487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:17.841026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.841476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.842281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:17.842729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:17.872707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d7441355-a871-4891-b6df-56f6588aab40 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Jun 24 08:53:17.873481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 417/938] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:17.892595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:17.900091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d16feac-151a-4bdd-a4f9-48376a2006f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158089 Jun 24 08:53:17.900651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 522/939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:18.314282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:18.315238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:18.321257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.321734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:18.322510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.322947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:18.351779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-401d909d-b238-4d17-a5b5-e5f573a82f1d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041400 Jun 24 08:53:18.352339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 418/940] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:18.884694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:18.885532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:18.892138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.892577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:18.893339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.893946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:18.918046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:18.918668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:18.926016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.926276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-91e29321-9529-4fcb-93b0-069188238de5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Jun 24 08:53:18.926504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:18.927800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 523/941] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:18.927950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:18.927950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:19.061431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:19.069135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-18c678e6-a5b1-4b69-8f57-2ad3e0cfccbe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155109 Jun 24 08:53:19.069755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 419/942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:19.364232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:19.365145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:19.372024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:19.372473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:19.373233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:19.373694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:19.403132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c86105f8-7bd1-4d39-86f1-9b5e5c5a1c70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042799 Jun 24 08:53:19.403694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 524/943] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:19.938866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:19.939797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:19.945951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:19.946401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:19.947175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:19.947610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:19.975261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-47597439-fd85-4941-8311-060e53652e8c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040517 Jun 24 08:53:19.975818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 420/944] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:20.087229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:20.087841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:20.094472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.094924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:20.095729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.096197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:20.244636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:20.252773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f23cc381-4e64-4159-a230-c6508f8540b5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.169602 Jun 24 08:53:20.253341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 525/945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:20.415191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:20.416131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:20.423113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.423562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:20.424347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.424781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:20.456963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ef8a047f-a2fe-4899-8cd5-2a3650b60d3f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045820 Jun 24 08:53:20.457551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 421/946] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:20.986982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:20.987962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:20.994106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.995163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:20.996002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:20.996431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.025548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b6a316eb-ddf9-4f8b-8a3f-ba202ccd90d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 Jun 24 08:53:21.026127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 526/947] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:21.270389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:21.270999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:21.277574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.278053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.278822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.279507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.409724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:21.418310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8dbe34c-1c39-4a30-83fc-9e490c0a7986 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151680 Jun 24 08:53:21.418907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 422/948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:21.472027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:21.472961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:21.480405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.480850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.481612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:21.482065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:21.512296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b5ea961-527c-4726-83ce-ac09d4a28e05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044358 Jun 24 08:53:21.512851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 527/949] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:22.037856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:22.038819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:22.044865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.045312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.046110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.046542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.074636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dde59b87-15b3-4b2d-9c1e-cac0819f62ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040740 Jun 24 08:53:22.075359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 423/950] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:22.436316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:22.436836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:22.442887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.443820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.444612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.445020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.523937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:22.524855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:22.531607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.532081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.532847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:22.533277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:22.563123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-99bbb85c-6706-4d55-b099-962addfab127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043071 Jun 24 08:53:22.563692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 424/951] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:22.580192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:22.587629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2232872b-49d5-4f31-b618-db97d6ad6c85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155806 Jun 24 08:53:22.588186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 528/952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:23.086716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:23.087658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:23.100080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.100555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.101331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.101827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.138472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7f3ea880-dd41-43c9-8611-dea35aeca497 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055754 Jun 24 08:53:23.139040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 425/953] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:23.575508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:23.576442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:23.583285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.584318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.584640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.584928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.604348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:23.604959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:23.611980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.613039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.613232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:23.613632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:23.618294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b2de782c-73ce-4414-bc40-c4b1c4804ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047392 Jun 24 08:53:23.618951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 529/954] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:23.749441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:23.757469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1654805a-a8df-445f-92da-8df6195e9e71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156893 Jun 24 08:53:23.758002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 426/955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:24.149350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:24.150295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:24.157194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.157636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.158424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.158851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.190831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37cc84c0-2742-46bd-81a4-55f6ffb3aea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Jun 24 08:53:24.191394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 530/956] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:24.632298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:24.633241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:24.640757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.641204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.642006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.642443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.656717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:24.673374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bdbb1004-e4df-4c71-9000-4d73a3797433 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045284 Jun 24 08:53:24.673989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 427/957] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:24.775924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:24.776577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:24.784284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.784738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.785539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:24.786014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:24.935216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:24.943696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-578005a6-3fb4-47ba-b63c-23ceda03540d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.171755 Jun 24 08:53:24.944280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 531/958] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:25.203501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:25.204164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:25.210095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.210537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:25.211291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.211719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:25.239597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8275e6e8-7110-49d5-a91a-fff1392883d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040531 Jun 24 08:53:25.240144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 428/959] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:25.685240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:25.686191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:25.692148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.692595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:25.693355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.693830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:25.722550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5d87add7-23e2-4c4b-b913-30cf2ee0fd5b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041417 Jun 24 08:53:25.723227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 532/960] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:25.961449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:25.962086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:25.969173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.969620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:25.970423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:25.970858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:26.104315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:26.112063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e8fb3e88-7079-404f-9943-7a3d0a579877 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154439 Jun 24 08:53:26.112627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 429/961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:26.251651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:26.252477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:26.259125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:26.259603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:26.261009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:26.261485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:26.265254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:26.291674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c99f9ec1-35a8-41f5-90c0-1a6acbb573f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Jun 24 08:53:26.292225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 533/962] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:26.734799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:26.735746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:26.741926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:26.742377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:26.743139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:26.743572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:26.772822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c9611eeb-d8c9-4295-817b-f0be612326bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Jun 24 08:53:26.773392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 430/963] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:27.129993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:27.130601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:27.137429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.137916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.138665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.139082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.268521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:27.276109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06698452-f555-4759-9564-398fe57dfdda tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150258 Jun 24 08:53:27.276672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 534/964] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:27.303120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:27.304040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:27.311061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.311503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.312263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.312697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.340065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c4734fc7-b7c8-4d5b-849f-461470b9b0f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040791 Jun 24 08:53:27.340609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 431/965] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:27.784660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:27.785603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:27.792278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.792730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.793481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:27.793945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:27.822521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-475860f3-7413-4aa0-a253-f8da1274758e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041777 Jun 24 08:53:27.823298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 535/966] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:28.293611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:28.294244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:28.300296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.300745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.301512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.301973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.351752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:28.352867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:28.359364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.359816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.360589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.361025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.391923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-931e921e-6beb-426a-b47f-7417c6807a3c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044129 Jun 24 08:53:28.392499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 536/967] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:28.434926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:28.442362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5be3003-3330-4f43-98fa-5ba8b76f3591 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152676 Jun 24 08:53:28.443136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 432/968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:28.833207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:28.834154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:28.840232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.840673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.841429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:28.841895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:28.870080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d33a6b15-7336-4bc7-abcc-13fe481ac873 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040751 Jun 24 08:53:28.871070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 537/969] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:29.403506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:29.404684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:29.411046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.411497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.412253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.412684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.441349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d501b68e-fc16-477c-8a48-8f01f2047e66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Jun 24 08:53:29.442046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 433/970] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:29.460147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:29.460756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:29.467347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.467793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.468548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.468981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.608395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:29.616638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-001ed199-8ae6-47fb-b432-77302bcf6f82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160271 Jun 24 08:53:29.617431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 538/971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:29.883203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:29.884121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:29.890541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.890985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.891811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:29.892239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:29.925763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-618750d8-70af-4856-9d1b-bcc80b67cc83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046954 Jun 24 08:53:29.926268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 434/972] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:30.453158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.454101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.460101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.460536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.461285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.461732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.489993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f1835ed1-2898-4b14-864a-3796b6fb879c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041362 Jun 24 08:53:30.490546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 539/973] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:30.633737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.634351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.641474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.641962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.642727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.643159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.775122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:30.783363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fcec567d-269f-47f7-957b-d0c6edfdf71e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153460 Jun 24 08:53:30.785036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 435/974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:30.937095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:30.938044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:30.944148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.944594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.945405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:30.945874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:30.975273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e364b9bc-8027-41a8-bf34-aa794d0a9991 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042578 Jun 24 08:53:30.975776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 540/975] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:31.501680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:31.502609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:31.508640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.509084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.509879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.510312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.539491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-194a6e19-c80b-4231-8c24-8521fcb152df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Jun 24 08:53:31.540044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 436/976] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:31.801614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:31.802316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:31.808781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.809227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.810036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.810467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.939411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:31.952652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8a84f191-1971-43ef-8bcb-c64829578b2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154676 Jun 24 08:53:31.953242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 541/977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:31.987470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:31.988392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:31.994875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.995356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:31.996128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:31.996561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.025721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-66e609c4-164f-4eee-b14d-2e3dd20d3467 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042483 Jun 24 08:53:32.026790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 437/978] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:32.551795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:32.552710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:32.559300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.559745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.560524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.560951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.588948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7543101e-1e31-424f-aa7f-8c6372a2eb88 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 Jun 24 08:53:32.589491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 542/979] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:32.970109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:32.970717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:32.976785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.977228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:32.978021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:32.978457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.039501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:33.040425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:33.047434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:33.047881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.048651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:33.049087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.079097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cd959fe7-27ff-43d8-81de-2f6569f6b553 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043564 Jun 24 08:53:33.079672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 543/980] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:33.108861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:33.116347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e083897f-0101-4bb6-9af7-c108e82f6d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150120 Jun 24 08:53:33.116903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 438/981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:33.599637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:33.600554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:33.607060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:33.607504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.608262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:33.608697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:33.638180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06d1e018-6c28-4c85-80a9-25e84cbf2362 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Jun 24 08:53:33.638734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 544/982] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:34.091508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:34.092456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:34.099070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.099517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.100279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.100707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.133212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9a82cdd5-4e7f-468a-8ce2-94335fdd2800 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046298 Jun 24 08:53:34.133911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:34.134400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 439/983] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:34.135186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:34.144920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.145378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.146186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.146627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.162360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-f7c58508-4d02-472d-bf5b-7c524f35f596 req-72c5e140-f3a6-49e1-8756-207755cae992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "name": "network-vif-unplugged", "status": "completed", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:53:34.169569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=78 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:34.171780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-f7c58508-4d02-472d-bf5b-7c524f35f596 req-72c5e140-f3a6-49e1-8756-207755cae992 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.172260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-f7c58508-4d02-472d-bf5b-7c524f35f596 req-72c5e140-f3a6-49e1-8756-207755cae992 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.184406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-f7c58508-4d02-472d-bf5b-7c524f35f596 req-72c5e140-f3a6-49e1-8756-207755cae992 service nova] Creating event network-vif-unplugged:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 08:53:34.192627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-f7c58508-4d02-472d-bf5b-7c524f35f596 req-72c5e140-f3a6-49e1-8756-207755cae992 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031554 Jun 24 08:53:34.193485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 440/984] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:34.285210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:34.292806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9e8b47a4-d11f-4ad7-9951-fde9c4884103 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163144 Jun 24 08:53:34.293401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 545/985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:34.650353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:34.651363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:34.657817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.658268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.659033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:34.659468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:34.689411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f4b470b9-ac5f-4fd7-8145-e2feb38e8cd3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jun 24 08:53:34.690276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 441/986] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:35.144859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.145876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:35.152294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.152743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.153498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.154226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.188789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d243475-a5e2-4e1f-9af2-071f6009b77d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047998 Jun 24 08:53:35.189355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 546/987] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:35.309888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.310484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:35.316936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.317387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.318185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.318620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.446554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:35.454522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5b464246-bae8-4d88-aba9-1cb7dd648c27 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149061 Jun 24 08:53:35.455086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 442/988] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:35.701763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:35.702615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:35.704510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=76 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:35.709962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.710413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.711192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:35.711627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:35.741029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f977d00-adc1-4f17-a0c8-efd76490c2bf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043800 Jun 24 08:53:35.741587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 547/989] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:36.200955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:36.201929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:36.208031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.208482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.209244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.209714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.238436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-55ccca50-d2ea-417e-bedb-7ea7d2b993d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041591 Jun 24 08:53:36.238979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 443/990] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:36.472267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:36.472873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:36.479517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.479955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.480711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.481161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.614436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:36.623230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a398f063-a0b5-462f-a4bc-0f02af2635f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154787 Jun 24 08:53:36.623835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 548/991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:36.753507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:36.754372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:36.760706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.761149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.761942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:36.763025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:36.786844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:36.791925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f7a5a7cf-73a7-4fc0-b1f9-2168433e22c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042835 Jun 24 08:53:36.792486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 444/992] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:37.250949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:37.251866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:37.257967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.258411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.259163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.259589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.283663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:37.288737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-98e30953-f552-4f3d-ada9-bcd366fe5faa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042430 Jun 24 08:53:37.289292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 549/993] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:37.640188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:37.640793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:37.646875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.647321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.648082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.648512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.778421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:37.791738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7460fdcf-ae7e-44b1-bfe5-22c49104ab46 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155240 Jun 24 08:53:37.792318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 445/994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:37.803608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:37.804534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:37.810986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.811422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.812291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:37.812724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:37.843009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f8bc66c-5898-45d1-9f39-ee342109c3f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Jun 24 08:53:37.843565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 550/995] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:38.300459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:38.301376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:38.307477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.307916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.308676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.309115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.337747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ecaa84a5-272d-4bdd-92af-b358d24b8f2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041237 Jun 24 08:53:38.338296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 446/996] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:38.809351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:38.810647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:38.817083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.817524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.818330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.818754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.854436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:38.855357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:38.862063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.862424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.863197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:38.863628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:38.893392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5bd68d3-5d8f-4d3f-9309-012b0f67975f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042802 Jun 24 08:53:38.893985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 447/997] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:38.955621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:38.963177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d3507f0f-b2c8-4584-ae19-e4de811af817 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157749 Jun 24 08:53:38.963737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 551/998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:39.350465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:39.351493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:39.357494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.357972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.358772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.359297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.390445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-01dee22e-b2da-4234-86fc-90559dc2519e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Jun 24 08:53:39.391037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 448/999] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:39.905380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:39.906283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:39.912836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.913281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.914078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.914517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.945450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c935476b-e983-4a02-9d1e-cad91c119080 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Jun 24 08:53:39.946059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 552/1000] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:39.980690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:39.982072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:39.988684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.989127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:39.989936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:39.990374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.124481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:40.131952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a915d939-9f05-447f-8020-e660f587dedf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155405 Jun 24 08:53:40.132506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 449/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:40.402589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:40.404132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:40.410097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.410537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.411286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.411712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.440422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-485477c6-5246-4086-8280-ac6a821794c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041819 Jun 24 08:53:40.440967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 553/1002] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:40.959023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:40.960051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:40.966126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.966583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.967614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:40.968059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:40.996391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5e207ad0-8483-4e52-8735-516aa049b4d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 Jun 24 08:53:40.997554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 450/1003] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:41.148427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:41.149115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:41.155900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.156345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.157112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.157549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.297720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:41.305542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71827b5f-d4bf-4f02-b2ef-2e01177ae242 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161027 Jun 24 08:53:41.306144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 554/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:41.452052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:41.453248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:41.459212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.459652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.460403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:41.460830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:41.488841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-88ec4b6e-87a1-469a-a33a-a8b92c6bd649 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040758 Jun 24 08:53:41.489377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 451/1005] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:42.008827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:42.009655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:42.017251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.017716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.018543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.018960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.048611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c51eb1b2-cc47-4f5f-a20a-14eba717396b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Jun 24 08:53:42.049169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 555/1006] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:42.323786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:42.324410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:42.331825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.332337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.333155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.333584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.472104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:42.480068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1cc68bbf-7b0f-44ab-baf9-3cccff13ae3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160088 Jun 24 08:53:42.480654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 452/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:42.501133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:42.502127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:42.508816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.509261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.510062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:42.510499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:42.541293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c9a4bb79-1a5d-4de1-9ada-cd995e574004 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044666 Jun 24 08:53:42.541896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 556/1008] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:43.059730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:43.060648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:43.066671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.067117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.067874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.068303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.096285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-220ccdf8-826d-49be-84f5-f6df24512d78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 Jun 24 08:53:43.096826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 453/1009] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:43.497505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:43.498064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:43.504253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.504830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.505490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.505917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.553273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:43.554330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:43.560850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.561369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.562240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:43.562750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:43.592847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7fc066f5-fafb-47b5-8caf-aa996ed517ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043527 Jun 24 08:53:43.593423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 454/1010] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:43.638949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:43.647562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-23c4cd71-cb99-4d9b-bf5f-17221864f78c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154133 Jun 24 08:53:43.648131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 557/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:44.108198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:44.109436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:44.115634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.116086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.116861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.117298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.147489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fa9ac96c-124d-4ab1-9b54-bfa2d83cc9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Jun 24 08:53:44.148032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 455/1012] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:44.604705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:44.605634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:44.613030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.613484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.614280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.614710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.644839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-232a72e9-d5af-4401-b9cd-ac5ca5d7eebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Jun 24 08:53:44.645400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 558/1013] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:44.666305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:44.666909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:44.674012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.674455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.675211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:44.675638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:44.864677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:44.880456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-62fb2e96-a923-4df6-9c5a-302f6b014206 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.217595 Jun 24 08:53:44.881517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 456/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:45.159371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.160342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.166361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.166811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.167580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.168024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.198719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bfe4b4f8-b190-4c57-b005-158a9524c94e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jun 24 08:53:45.199299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 559/1015] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:45.656441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.657346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.663378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.663817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.664570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.664996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.693198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6360b9dc-93c2-4dcb-9e4c-d23f03b63370 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041400 Jun 24 08:53:45.693860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 457/1016] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:45.906785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:45.907352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:45.913788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.914233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:45.914977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:45.915402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.098806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:46.106374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7efc4019-4f86-418f-b53b-4d8382fe7d9f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.204129 Jun 24 08:53:46.107123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 560/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:46.211603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:46.212580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:46.218508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.218951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.219703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.220129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.248146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ad88013-e53e-4b5b-93bc-55d8b77809c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040480 Jun 24 08:53:46.248691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 458/1018] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:46.704658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:46.705489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:46.711456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.711903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.712650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:46.713077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:46.741908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3373b404-a4a2-46c4-af00-d99043e37c8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041295 Jun 24 08:53:46.742453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 561/1019] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:47.124179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:47.124788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:47.131381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.131825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.132600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.133037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.259759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:47.260689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:47.267375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.267815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.268189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:47.268582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.269007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.276410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6f4fec69-9fb0-4ef8-aab1-dc4e4167b135 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156669 Jun 24 08:53:47.277034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 459/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:47.299374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-250307b4-bad1-411f-b676-321c00de32ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Jun 24 08:53:47.299924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 562/1021] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:47.753650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:47.754586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:47.760544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.760988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.761772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:47.762203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:47.790260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bdfd7629-0435-4a17-a3ef-f0bdc1bed8ba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040573 Jun 24 08:53:47.790814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 460/1022] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:48.294600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:48.295243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:48.302026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.302488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.303249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.303684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.311007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:48.311932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:48.318602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.319055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.319828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.320258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.334733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:48.351085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34a72a98-23f4-4888-82cb-e2706351d808 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Jun 24 08:53:48.351712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 461/1023] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:48.441202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:48.449572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87cce725-ccdd-4820-9eab-57fd6fa1446d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159292 Jun 24 08:53:48.450210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 563/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:48.802629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:48.803583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:48.810172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.810628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.811397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:48.811839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:48.839969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3dac5f5b-a6df-4e8c-93a3-94e2723c480c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041330 Jun 24 08:53:48.840528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 462/1025] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:49.363582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:49.364498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:49.370956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.371405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.372156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.372588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.401555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-52d2da92-fbc5-44de-a2e3-ae306b2e0266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041969 Jun 24 08:53:49.402119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 564/1026] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:49.469513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:49.470177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:49.476293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.476737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.477512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.477970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.609529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:49.617377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c9767a73-ffa6-4e3a-bf91-be21569188f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152429 Jun 24 08:53:49.617912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 463/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:49.851690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:49.852605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:49.858613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.859062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.859823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:49.860254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:49.889890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-09d636ca-1c2b-4e52-bcfa-0744efdb6973 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042044 Jun 24 08:53:49.890370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 565/1028] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:50.413654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:50.414600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:50.421080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.421524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.422311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.422746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.451482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-415c5c72-da12-46ee-9912-4bf3f54cfff3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jun 24 08:53:50.452035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 464/1029] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:50.640750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:50.641355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:50.647542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.647988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.649985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.649985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.665107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:50.790049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:50.798387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4cf2e06c-e42c-4c10-8888-4306ff274045 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.167551 Jun 24 08:53:50.798961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 566/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:50.901586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:50.902540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:50.909258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.909731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.910488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:50.910935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:50.943538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-957f0b81-bba6-42ef-ba51-13fd1c7d8dbd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045825 Jun 24 08:53:50.944008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 465/1031] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:51.463242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:51.464156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:51.470884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.471327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:51.472135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.472566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:51.500822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0bd529ea-2d5f-498c-85ee-6d83c4f72ad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041520 Jun 24 08:53:51.501363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 567/1032] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:51.815042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:51.815647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:51.821740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.822186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:51.822952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.823381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:51.958286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:51.966219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:51.967736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:51.969427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0c3c5927-cf2b-4b43-9774-865a51e4844d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158029 Jun 24 08:53:51.970091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 466/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:51.975255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.975501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:51.976307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:51.976745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:52.007852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-223dc042-50ca-466d-bf19-8c1ee2784d2a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050023 Jun 24 08:53:52.008441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 568/1034] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:52.511579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:52.512503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:52.518497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:52.518944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:52.519703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:52.520136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:52.549290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7842778-2432-4e31-819e-f7d01a1dceda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041667 Jun 24 08:53:52.549886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 467/1035] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:52.988458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:52.989126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:52.995670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:52.996118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:52.996891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:52.997329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:53.022190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:53.023139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:53.030728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:53.030728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:53.031595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:53.031978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:53.062912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-254fe3c0-3831-4a4a-9152-ccad63c3368f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045841 Jun 24 08:53:53.063493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 468/1036] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:53:53.133433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:53.141451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62452b75-2287-4010-aed6-8ef289a8ad85 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156842 Jun 24 08:53:53.142056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 569/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:53.560847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:53.561828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:53.567783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:53.568229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:53.568983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:53.569412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:53.597339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-95f407ff-41fa-4b98-9ced-ab33be5ea3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040428 Jun 24 08:53:53.597910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 469/1038] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:54.074830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:54.075759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:54.082323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.082777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.083545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.083976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.112425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-66cf6f4f-e308-4432-8f53-e87890d16441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041577 Jun 24 08:53:54.112964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 570/1039] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:54.158743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:54.159346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:54.165840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.166288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.167052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.167482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.313656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:54.321455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6320a9d9-c09c-4640-8211-04a6f7a054f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.166514 Jun 24 08:53:54.322148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 470/1040] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:54.608033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:54.608980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:54.615286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.615732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.616505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:54.616936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:54.647427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eeb56f89-eed3-4968-8b00-ac1b38ae9a11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043334 Jun 24 08:53:54.647977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 571/1041] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:55.124873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:55.125814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:55.131811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.132258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.133027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.133460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.162147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5f73098c-aea8-4eb0-a520-533bd45cd093 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041873 Jun 24 08:53:55.162854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 471/1042] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:55.339935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:55.340542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:55.347210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.347665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.348440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.348908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.483915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:55.491917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d6544026-efc1-4c32-81f1-1c9a47a97e33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155930 Jun 24 08:53:55.492496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 572/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:55.659624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:55.660475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:55.667153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.667607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.668391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:55.668833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:55.699690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-435d4267-ccd7-4ed0-9dd5-401359b6ca89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Jun 24 08:53:55.700283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 472/1044] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:56.173947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:56.174868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:56.180947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.181386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.182286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.182610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.214479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a03300d-0509-4f8e-bdc8-412d233b8085 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Jun 24 08:53:56.215037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 573/1045] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:56.509591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:56.510231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:56.516782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.517228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.518018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.518448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.652139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:56.660407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d290c5f-1dc7-4c3a-aa17-64ebbbd49f48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154676 Jun 24 08:53:56.660965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 473/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:56.711675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:56.712521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:56.719626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.720078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.720847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:56.721285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:56.750073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ca08176-7052-421d-9a18-a04aa95ad774 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Jun 24 08:53:56.750629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 574/1047] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:57.227008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:57.227962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:57.234533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.234977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.235745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.236176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.267162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78c15248-cc21-4944-a3ea-d80b5f1e60a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044161 Jun 24 08:53:57.267718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 474/1048] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:57.678202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:57.678802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:57.685278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.686341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.687107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.687536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.761734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:57.762670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:57.768946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.769396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.770205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:57.770645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:57.801768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-47741850-9876-4c1b-be65-2c70537592cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Jun 24 08:53:57.802354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 475/1049] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:53:57.820673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:57.828465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-310813eb-5374-4d04-9d03-b8e9d775e239 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154079 Jun 24 08:53:57.829038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 575/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:53:58.280168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:58.281084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:58.287550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.287997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.288764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.289198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.318690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9bb4d1a5-a69c-4a4c-98c9-6d4c1f745cf3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043594 Jun 24 08:53:58.319240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 476/1051] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:58.812557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:58.813487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:58.820164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.820613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.821384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.821948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.846126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:58.846821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:58.851036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-360b210a-2893-4d52-8c40-6a25f38c14ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042436 Jun 24 08:53:58.851669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 576/1052] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:53:58.852963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.853419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.854225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:58.854669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:58.989879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:53:58.997335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e231b933-0376-4cb3-80df-48006a20b208 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155613 Jun 24 08:53:58.998308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 477/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:53:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:53:59.331060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:59.331985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:59.338012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:59.338466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:59.339237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:59.339674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:59.368268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b2f5b36-f040-45cd-9b96-b906e1a1bfc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041201 Jun 24 08:53:59.368816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 577/1054] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:53:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:53:59.863390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:53:59.864246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:53:59.870937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:59.871386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:59.872154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:53:59.872589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:53:59.877467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:59.902328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-946f130b-da28-414a-bb07-ee29a05c860a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Jun 24 08:53:59.902878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 478/1055] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:53:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:00.013606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:00.014248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:00.020758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.021201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.021988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.022421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.155177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:00.162758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dcc79b0f-06d6-48a3-9fb6-1af8840b9b66 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152993 Jun 24 08:54:00.163320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 578/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:00.380392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:00.381342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:00.387520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.387964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.388726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.389163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.420361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6bd83808-bd37-4ea6-834f-b07d7958a3bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044467 Jun 24 08:54:00.420835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 479/1057] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:00.914889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:00.915845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:00.921846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.922305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.923075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:00.924170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:00.953205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8410845e-5683-49a1-bfd2-ee2580b9d4ff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 Jun 24 08:54:00.953783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 579/1058] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:01.180428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:01.180959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:01.187353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.187797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:01.188550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.188979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:01.316154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:01.323763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dd93f215-3437-4a6d-a4f0-566cb5789eb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147226 Jun 24 08:54:01.324332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 480/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:01.432922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:01.433787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:01.440246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.440701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:01.441475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.441935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:01.471359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b228453-e77f-4e40-86bc-c8b3698c8e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042478 Jun 24 08:54:01.471915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 580/1060] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:01.965110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:01.966112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:01.972134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.972582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:01.973346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:01.973810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:02.003717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-42666b26-2c98-429f-9de7-f76556f2b02a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Jun 24 08:54:02.004281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 481/1061] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:02.341732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:02.342372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:02.348386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:02.348830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:02.349586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:02.350046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:02.483284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:02.484208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:02.488497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:02.491351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:02.491801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:02.492572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:02.493007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:02.496117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a161b2eb-5d02-486c-9b2d-67552aa25049 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158290 Jun 24 08:54:02.496686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 581/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:02.521819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3e807d8c-bd31-43fd-9353-eaa438082a51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042476 Jun 24 08:54:02.522373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 482/1063] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:03.015794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:03.017230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:03.023288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.023741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.024499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.024935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.053595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:54:03.053861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:54:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:54:03.061102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1505f2e1-118f-4aad-a4c2-820e270481af tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049373 Jun 24 08:54:03.061697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 582/1064] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:03.513773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:03.514460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:03.520760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.521202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.522129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.522433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.602428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:03.603348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:03.611534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.611982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.613007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:03.613447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:03.616116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:03.645111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d757ea5-9a76-497f-a9a3-3657132a899e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115059 Jun 24 08:54:03.645715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 583/1065] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:03.662684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:03.670262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bbc0b0b3-caad-49d5-9453-f4ac4d8d1470 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160393 Jun 24 08:54:03.670829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 483/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:04.072736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:04.073682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:04.080567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.081014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.081812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.082251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.111100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-88686cc2-55a5-4b37-8525-3203266883a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Jun 24 08:54:04.111646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 584/1067] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:04.656899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:04.658370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:04.660671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=88 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:04.665883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.666344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.667114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.667550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.688001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:04.688628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:04.695457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.695858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.696665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:04.697102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:04.697384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2a4dcd8c-539a-45e3-a1b8-6be4bd3e1088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044698 Jun 24 08:54:04.698082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 484/1068] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:05.059398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:05.066914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7d8ef98c-68d4-4a83-b934-d036311ae747 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.382929 Jun 24 08:54:05.067474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 585/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:05.122617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:05.123536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:05.129463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:05.129940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:05.130707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:05.131139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:05.159842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8ad5f0aa-7335-4237-a840-c12cd3e015c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Jun 24 08:54:05.160395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 485/1070] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:05.709151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:05.710107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:05.712416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=78 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:05.718354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:05.718804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:05.719578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:05.720009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:05.748997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c0a05cb7-6848-44f8-940b-8facce070211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044444 Jun 24 08:54:05.749552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 586/1071] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:06.084801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:06.085402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:06.091782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.092225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.092978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.093419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.173018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:06.173018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:06.178787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.179263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.180037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.180480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.210798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fd2f76d9-3f18-4d33-a58e-a19b0dd9cce1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043430 Jun 24 08:54:06.211605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 587/1072] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:06.227864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:06.235494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d000a218-08fe-4905-aafe-64bd90e52c67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154794 Jun 24 08:54:06.236050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 486/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:06.761424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:06.762283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:06.768759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.769201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.770016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:06.770446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:06.800742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-41f2a065-2a7e-46cc-b43b-4ba7faedea55 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043159 Jun 24 08:54:06.801298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 588/1074] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:07.221999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:07.222946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:07.229549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.230037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.230846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.231277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.234828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:07.236132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:07.242206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.242665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.243441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.243908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.260947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e90d10c7-06ab-4eac-9570-602940de1f8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043291 Jun 24 08:54:07.261974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 589/1075] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:07.265894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:07.267002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:07.269739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:54:07.272733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.273185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.273969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.274406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.347490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d16ec29-55a5-4a8b-a438-37b1885d461f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 204 len: 0 microversion: 2.1 time: 0.162200 Jun 24 08:54:07.348186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 487/1076] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:54:07 2022] DELETE /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:54:07.356612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:07.357320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:07.365515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.366315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.367165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.367627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.426017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:07.433522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32f0cf76-2b6a-441a-b184-47d834502a59 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.171044 Jun 24 08:54:07.434112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 590/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:07.508945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:07.516403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e3e56094-e7ba-4be4-a7b3-6e33d5fd69c3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1574 microversion: 2.1 time: 0.163893 Jun 24 08:54:07.516983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 488/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:07.814654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:07.815570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:07.822130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.822568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.823317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:07.823745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:07.853314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d5e01074-37fb-4ae9-a49d-416f39509d1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042817 Jun 24 08:54:07.853906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 591/1079] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:08.272990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:08.274006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:08.280788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.281237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.282766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.283121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.311077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1afc3792-ff5d-4afc-876d-a68bb7eb13cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042025 Jun 24 08:54:08.311626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 489/1080] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:08.450586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:08.451195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:08.457798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.458247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.459009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.459441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.534702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:08.535337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:08.541497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.541996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.542775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.543215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.595746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:08.603260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d38713e-1baf-43e6-be9a-35d4558f25c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156489 Jun 24 08:54:08.603827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 592/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:08.685178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:08.693156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9637457b-9dd6-4f9a-b49a-77ddbd502af7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1574 microversion: 2.1 time: 0.162543 Jun 24 08:54:08.693731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 490/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:08 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:08.865673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:08.866518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:08.873015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.873447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.874240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:08.874772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:08.904817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e80e407-3d5a-4f2b-9d30-8f81f306696a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043740 Jun 24 08:54:08.905367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 593/1083] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:09.322927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:09.323897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:09.330374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.330859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.331642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.332078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.361717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7e0093d-ee43-4bfd-ac3d-d96082a6afe1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042217 Jun 24 08:54:09.362288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 491/1084] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:09.620464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:09.621073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:09.627012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.627467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.628228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.628665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.710932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:09.711921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:09.718793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.719486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.721330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.722092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.764155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:09.772956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-73dcc1da-7550-4c31-abed-9a80e8047f50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156284 Jun 24 08:54:09.773879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 594/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:09.796032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:09.803827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6e19ecb6-cc8f-4cbd-8a5d-2d56cd7ebe79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1508 microversion: 2.1 time: 0.097081 Jun 24 08:54:09.805706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 492/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:09 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1508 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:09.916705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:09.917759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:09.924401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.924908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.925800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:09.926307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:09.957487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b3376ef-b287-47b2-b737-154efdddac98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Jun 24 08:54:09.958087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 595/1087] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:10.284854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-9297e833-195f-4048-bebb-a1f9ed16d208 req-a4d9dce2-df1d-4622-aa0a-ad980b114899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ddcaa83-a766-4122-8923-3bb23b844391", "name": "network-vif-deleted", "tag": "a335388c-49c2-4c7a-afdc-1bab81d059f5"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:54:10.294209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-9297e833-195f-4048-bebb-a1f9ed16d208 req-a4d9dce2-df1d-4622-aa0a-ad980b114899 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.295029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-9297e833-195f-4048-bebb-a1f9ed16d208 req-a4d9dce2-df1d-4622-aa0a-ad980b114899 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.300063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:10.326951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-9297e833-195f-4048-bebb-a1f9ed16d208 req-a4d9dce2-df1d-4622-aa0a-ad980b114899 service nova] Creating event network-vif-deleted:a335388c-49c2-4c7a-afdc-1bab81d059f5 for instance 9ddcaa83-a766-4122-8923-3bb23b844391 on hv-cinder-78729 Jun 24 08:54:10.335702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-9297e833-195f-4048-bebb-a1f9ed16d208 req-a4d9dce2-df1d-4622-aa0a-ad980b114899 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054404 Jun 24 08:54:10.336409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 493/1088] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:10.373080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:10.374610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:10.382241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.382790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.383636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.384134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.414012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e44a5103-ad21-4b3a-a005-a33075807a00 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045439 Jun 24 08:54:10.414711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 596/1089] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:10.791566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:10.792868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:10.801336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.801843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.802787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.803240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.821609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:10.823793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:10.831916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.832816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.834393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.835062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.920019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:10.928123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9654cf02-e111-4daa-8d87-2c056200ae24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.111573 Jun 24 08:54:10.929326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 597/1090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:10.970109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:10.971709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:10.978650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.979382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.980519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:10.980846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:10.996777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:11.004880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-92ddaed9-1f04-4d38-a25a-ca235c33c33d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.217856 Jun 24 08:54:11.005680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 494/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:11.036046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-077cc8d4-8633-4e3a-8684-7728d1eeb9c2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.071163 Jun 24 08:54:11.036626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 598/1092] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:11.425804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:11.426822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:11.433426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:11.433905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:11.434671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:11.435111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:11.465514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8aa17efe-9b34-4118-a9aa-8cd475e2fd6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043777 Jun 24 08:54:11.466110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 495/1093] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:11.944292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:11.944911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:11.951526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:11.951975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:11.952740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:11.953175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.016109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:12.019010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:12.023994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:12.024607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:12.026072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f95d9173-5195-41d9-8aa0-466456c08f75 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085591 Jun 24 08:54:12.026961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 599/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:12.041018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.041468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.042269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.042702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.049813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:12.050843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:12.057216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.057804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.058666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.059213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.088680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-82e525d4-9788-45c7-8230-910f76b5b7bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043396 Jun 24 08:54:12.089399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 600/1095] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:12.176562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:12.184459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c50a4da1-d002-4ab7-a59f-6f8d4244c2b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.164381 Jun 24 08:54:12.184999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 496/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:12.477408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:12.478209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:12.484996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.485457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.486273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:12.486706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:12.515911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a3f2d35f-42ba-4cee-9e64-395f343fa266 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042709 Jun 24 08:54:12.516485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 601/1097] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:13.044382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:13.044997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:13.051883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.052328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.053087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.053518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.100953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:13.101901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:13.108447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.108904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.109690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.110129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.116420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:13.123830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-88f29383-1178-45ba-b49a-53f04b560aa7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083326 Jun 24 08:54:13.124399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 497/1098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:13 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:13.139614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b072f0be-2442-4ccc-8760-de6dca3ceea0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042798 Jun 24 08:54:13.140165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 602/1099] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:13.201700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:13.202334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:13.209069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.209520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.210319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.210752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.336882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:13.344430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ccd7c4ee-d1f8-4dac-b53c-9559fbeb4148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.146599 Jun 24 08:54:13.345000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 498/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:13.528101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:13.529013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:13.535052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.535496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.536252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:13.536680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:13.565745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-08e65cc5-8de2-4e87-aa81-5cb3ee51ff87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Jun 24 08:54:13.566293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 603/1101] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:14.141202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:14.141835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:14.148723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.149170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.149958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.150388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.152380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:14.153556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:14.160738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.161191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.162436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.197941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-257abb54-e708-4db7-aafa-c7f7c9ac5f19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049229 Jun 24 08:54:14.198410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 604/1102] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:14.217385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:14.225541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6d1e31b9-2b0e-420b-b899-0c0a12f9cf55 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088295 Jun 24 08:54:14.226137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 499/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:14.361174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:14.361823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:14.367960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.368407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.369176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.369613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.506424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:14.513832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-550134a4-833a-4c9f-b553-22faab4472b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156589 Jun 24 08:54:14.514397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 605/1104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:14.577204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:14.578210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:14.584826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.585268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.586050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:14.586488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:14.614325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-182beeac-b91c-405f-87f6-884322789b4b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041023 Jun 24 08:54:14.614883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 500/1105] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:15.210487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:15.211405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:15.217940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.218386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.219139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.219567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.242686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:15.243296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:15.249599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.250081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.250408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-650301b3-ede6-4268-a508-08a8ca3fa2f0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043955 Jun 24 08:54:15.250870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.251287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.252010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 606/1106] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:15.312114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:15.319534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5eb4d62b-2435-4e70-8586-1dd6aa8e1391 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080685 Jun 24 08:54:15.320129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 501/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:15 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:15.532119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:15.533406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:15.539478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.539928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.540684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.541122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.625798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:15.626800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:15.632982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.633429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.634224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:15.634660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:15.665291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c595aeac-9bd7-4059-b8f0-3410bc972ba3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Jun 24 08:54:15.665883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 502/1108] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:15.672509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:15.680095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d13ab095-a851-42a6-9498-40e6ad9af8e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152122 Jun 24 08:54:15.680654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 607/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:16.262212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:16.263126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:16.270112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.270559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.271320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.271753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.301196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-867fc28b-853f-4bf0-a022-4e54b76fe7cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042949 Jun 24 08:54:16.301782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 503/1110] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:16.336201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:16.336730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:16.343199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.343642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.344396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.344832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.405379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:16.412819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2c270d2d-ce5a-4133-9765-f12df537cbf7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080538 Jun 24 08:54:16.413372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 608/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:16 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:16.676802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:16.677774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:16.683684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.684134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.684894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.685332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.696170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:16.696781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:16.702885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.703336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.704118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:16.704554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:16.714244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f84dfadc-8dff-49b9-a9b2-71a93aa77b65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Jun 24 08:54:16.715499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 504/1112] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:16.834311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:16.841726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b9e1427-c685-4202-afa3-fc64024d182a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149340 Jun 24 08:54:16.842322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 609/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:17.313044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:17.313989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:17.320437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.320875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.321635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.322093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.351521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09041519-5416-44e3-bfe5-3becdc9d28a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042469 Jun 24 08:54:17.352080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 505/1114] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:17.429613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:17.430242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:17.436861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.437308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.438134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.438571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.505977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:17.513455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-221d3477-e546-48b2-a760-9fdc8f3f5003 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087826 Jun 24 08:54:17.514052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 610/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:17.725926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:17.726850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:17.732958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.733417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.734232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.734675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.762484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cb032bca-853c-4f71-9ae2-a6d22232c58d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040479 Jun 24 08:54:17.762963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 506/1116] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:17.859586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:17.860591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:17.867245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.867769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.868582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:17.869016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:17.998656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:18.006089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7f4d5a4-a3f5-447f-a48c-33bd8e390b81 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150490 Jun 24 08:54:18.006646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 611/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:18.363454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:18.364374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:18.370878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.371327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.372090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.372522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.401750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2c496c51-41eb-4705-b065-1dd6240a2546 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042201 Jun 24 08:54:18.402295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 507/1118] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:18.531045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:18.531650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:18.538212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.538656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.539411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.539840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.600108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:18.607945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed627619-597b-4e20-9c3c-925798771d5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081021 Jun 24 08:54:18.608520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 612/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:18.774024 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:18.774954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:18.781288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.781762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.782525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:18.782996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:18.811279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5929a25-ee04-4f18-aca0-0344f166eed6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041228 Jun 24 08:54:18.811843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 508/1120] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:19.023236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:19.023841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:19.030598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.031030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.031794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.032226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.172502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:19.180625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eba598c8-af3c-4d3c-867a-2c537248859b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161352 Jun 24 08:54:19.181180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 613/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:19.413580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:19.414441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:19.420655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.421103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.421910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.422347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.450909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1633ae5d-a28b-4879-8d41-f9d7e6dc9096 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041372 Jun 24 08:54:19.451468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 509/1122] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:19.624297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:19.624896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:19.631899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.632341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.633097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.633530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.695745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:19.703154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21962e0d-afb3-4409-88cc-a3f7010a7b4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082714 Jun 24 08:54:19.703711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 614/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:19 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:19.823565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:19.824491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:19.831021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.831465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.832230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:19.832665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:19.846360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:19.861836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8fbd2c64-facc-4c9a-9cfe-8a2d05797d50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042228 Jun 24 08:54:19.862392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 510/1124] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:20.197816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:20.198418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:20.204847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.205292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.206078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.206505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.335046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:20.342589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-26f82abb-1127-4868-8b11-d257b25895d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148708 Jun 24 08:54:20.343140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 615/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:20.463219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:20.464045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:20.471032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.471922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.472242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.472676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.502434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6e0dad80-5006-498e-bf4d-d61201ffd745 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043196 Jun 24 08:54:20.502990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 511/1126] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:20.721156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:20.721691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:20.728245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.728684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.729436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.729893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.744671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:20.795159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:20.802785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-107bdfc5-e276-45f9-b355-3da83cd27abc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086367 Jun 24 08:54:20.803358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 616/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:20.872483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:20.873433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:20.879491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.879932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.880689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:20.881144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:20.911804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a1b24827-a387-43d7-bd71-2537775fb4ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Jun 24 08:54:20.912364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 512/1128] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:21.361209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:21.361846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:21.367817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.368259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.369007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.369436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.499612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:21.507686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d172964b-0a78-405e-b6b2-2307a6cbae1b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150732 Jun 24 08:54:21.508255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 617/1129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:21.513958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:21.514877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:21.521543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.522023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.522779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.523205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.552236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-452eb8d5-f7f0-4ad5-914a-eb07807190a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042103 Jun 24 08:54:21.552711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 513/1130] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:21.819544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:21.820087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:21.826761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.827205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.827961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.828389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.889757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:21.897290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a918161-c4f7-4159-89cc-cec31505cf78 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081734 Jun 24 08:54:21.897875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 618/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:21.923707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:21.924698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:21.930702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.931140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.931897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:21.932322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:21.962726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-235d9da8-2189-4351-abf3-f8f336b428b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043460 Jun 24 08:54:21.963283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 514/1132] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:22.524084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:22.524730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:22.531000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.531439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.532808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.533240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.563813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:22.564776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:22.571256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.571698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.572464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.572890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.604105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-49f840ff-c51a-4af5-bbc2-15207be7ff30 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044151 Jun 24 08:54:22.604677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 515/1133] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:22.666064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:22.673641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d1f101f3-15dd-4721-a340-47d0b9e052b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153370 Jun 24 08:54:22.674230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 619/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:22.914085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:22.914696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:22.920657 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.921105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.921892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.922330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.974298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:22.975252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:22.981833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.982281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.983019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:22.983157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:22.983464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:22.991072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c15c2601-b6b6-4bfb-aa9e-539bd2de0b73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080804 Jun 24 08:54:22.991631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 516/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:22 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:23.013229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-122ea247-0f29-4a02-8bc2-1932ae569ba5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 Jun 24 08:54:23.013800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 620/1136] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:23.617148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:23.618099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:23.624511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:23.624953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:23.625740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:23.626173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:23.654478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e0954b35-873f-4056-bdfa-506225a69246 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041271 Jun 24 08:54:23.655020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 517/1137] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:23.690837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:23.691372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:23.697355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:23.697831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:23.698596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:23.699030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:23.826160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:23.834059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ea0f3129-e65a-4572-bc11-0234a68c36d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147094 Jun 24 08:54:23.834621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 621/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:24.008380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:24.008993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:24.014994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.015445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.016213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.017152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.024651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:24.025575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:24.033470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.033932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.035330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.035769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.065001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8551edb-f919-4e41-bcc6-e238966b946e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Jun 24 08:54:24.065569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 622/1139] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:24.082538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:24.089944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3dcad2ca-9f73-4620-b44a-0aaa8d8ed229 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085444 Jun 24 08:54:24.090504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 518/1140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:24.666271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:24.667285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:24.673949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.674395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.675152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.675589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.705233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c9c0af4c-97cf-431d-98fb-b84906f6ff0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042947 Jun 24 08:54:24.705845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 623/1141] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:24.851084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:24.851716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:24.858219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.858661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.859417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:24.859846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:24.989780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:24.997416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fcb9adf0-f4d9-48b3-b519-3f97a3533aae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150206 Jun 24 08:54:24.998001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 519/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:25.076438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:25.077367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:25.084492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.084942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.085725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.086159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.107104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:25.107738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:25.113652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.114128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.114897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.115333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.115457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-844d0226-7be4-4415-a9b0-ab6c1b931e45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042850 Jun 24 08:54:25.115901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 624/1143] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:25.176328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:25.183788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-66f55ccd-dfdb-450f-b48b-7ea5d29df058 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080480 Jun 24 08:54:25.184347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 520/1144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:25.717029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:25.717980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:25.724000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.724440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.725191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:25.725623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:25.754262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f2c66782-4b7d-47f0-a8e8-924b13591965 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041240 Jun 24 08:54:25.754805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 625/1145] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:26.014834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:26.015443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:26.022197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.022649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.023423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.023868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.127092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:26.128593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:26.135158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.135610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.136380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.136858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.158144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:26.165855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d2a703c5-ddbb-4117-8dfd-5450ef6c9126 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154767 Jun 24 08:54:26.166580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 521/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:26.166732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de126683-2402-4c6b-9282-30ab3e94763c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Jun 24 08:54:26.167162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 626/1147] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:26.200648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:26.201254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:26.207349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.207796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.208552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.208987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.268677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:26.276147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e72f7e3-9591-4ac2-b432-c984616d1038 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079327 Jun 24 08:54:26.276700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 522/1148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:26.766036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:26.766954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:26.773032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.773480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.774265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:26.774703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:26.803476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b72c7cd6-03bf-4882-87be-87e739ccbae5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041486 Jun 24 08:54:26.804025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 627/1149] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:27.178792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:27.179785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:27.183429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:27.184043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:27.186317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.186760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.187536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.187997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.190654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.191100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.191865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.192298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.216597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96cfcfc2-6b6d-4190-b6fb-4b5c442fcfc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042295 Jun 24 08:54:27.217158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 523/1150] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:27.293520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:27.294247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:27.300885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.301407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.302199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.302628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.322974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:27.330409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-88adac77-b160-4d83-bbee-32b41f73cfd2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150778 Jun 24 08:54:27.330971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 628/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:27.366270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:27.373807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-44dbb87c-d0dc-46a1-91dc-a639962c56f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084184 Jun 24 08:54:27.374359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 524/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:27.814377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:27.815801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:27.821760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.822207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.822954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:27.823383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:27.852354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5b6c58f2-05dc-4af3-a347-10f98a2e61b0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041946 Jun 24 08:54:27.852898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 629/1153] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:28.228552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:28.229509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:28.235955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.236403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.237698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.238143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.267091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ed9fb3a5-9b47-420a-a54d-9788d0469175 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042550 Jun 24 08:54:28.267647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 525/1154] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:28.348166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:28.348781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:28.356062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.356511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.357272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.357737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.390595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:28.391220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:28.397468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.400383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.400383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.400383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.476782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:28.485847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6509eb3e-fec0-4bca-bdae-62245f3f8772 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098946 Jun 24 08:54:28.486446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 526/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:28 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:28.510820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:28.518331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6f543197-f0d5-4515-abfd-09a39cd624b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.174802 Jun 24 08:54:28.518933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 630/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:28.863850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:28.864782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:28.870986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.871433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.872195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:28.872630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:28.875070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:28.903171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e1298ae0-a6ad-4154-9b5e-588858806ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043317 Jun 24 08:54:28.903719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 527/1157] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:29.279093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:29.280012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:29.286686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.287128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.287881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.288310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.316476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6c927634-37c3-4cb8-b436-5a40f7a38e3d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Jun 24 08:54:29.317027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 631/1158] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:29.503168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:29.503769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:29.510224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.510668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.511424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.511854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.536399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:29.536967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:29.552316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.552768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.553542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.554000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.573385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:29.580795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-56bb9cb5-edd2-4343-87c8-b9f02116a080 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081511 Jun 24 08:54:29.581505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 528/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:29 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:29.687503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:29.695027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8ab87eac-ab0f-40e9-a9e0-052ba963e0a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163149 Jun 24 08:54:29.695599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 632/1160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:29.914995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:29.915857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:29.921943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.922394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.923153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:29.923587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:29.951980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bdd28101-5ed4-4bdf-878c-89ff9121bfe3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041006 Jun 24 08:54:29.952541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 529/1161] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:30.328049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:30.328976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:30.335933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.336384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.337154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.337614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.340092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:30.367942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-926373dd-9016-400c-8c70-47fcb49640d1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043818 Jun 24 08:54:30.368492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 633/1162] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:30.597238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:30.597804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:30.604273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.604721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.605520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.605983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.667191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:30.675390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fa237f38-b38b-45f1-a7f3-e21828bc397c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082033 Jun 24 08:54:30.675958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 530/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:30.712130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:30.712734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:30.719317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.719765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.720532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.720964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.851654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:30.859139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c3b00d00-4e46-4694-b1ab-6ea0017516b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150830 Jun 24 08:54:30.859706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 634/1164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:30.964585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:30.965504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:30.967382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:30.973640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.974102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:30.974865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:30.975295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.005175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c6e06c0a-3f2f-42d3-ae8d-0ec38be87383 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044796 Jun 24 08:54:31.005741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 531/1165] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:31.379557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:31.380481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:31.386493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.386934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.387693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.388123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.416959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a973c061-9efa-4dc7-b38d-4c94cbccea0d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Jun 24 08:54:31.417579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 635/1166] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:31.692590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:31.693147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:31.699644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.700089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.700845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.701273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.764470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:31.772459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-49ab98f3-4f58-4a0c-b3e7-0bdafffbac32 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084341 Jun 24 08:54:31.773601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 532/1167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:31.876232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:31.876834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:31.879667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:31.885138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.885588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:31.886375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:31.886806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.016889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:32.017077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:32.018443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:32.024492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.024933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.025434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d68e881c-dcbd-4b1b-8328-4ca9b09098b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152980 Jun 24 08:54:32.025722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.026059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 636/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:32.026224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.056154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0258840c-ec0d-4cff-bbf3-6734d2543a32 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043190 Jun 24 08:54:32.056748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 533/1169] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:32.428433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:32.429346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:32.435331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.435773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.436527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.436955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.466244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b0a4539-0a6f-49da-a525-fd8d446a91fa tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041695 Jun 24 08:54:32.466807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 637/1170] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:32.790353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:32.790955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:32.797315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.797792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.798547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:32.798978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:32.860139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:32.868084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd9b3d19-59c9-4e85-a015-20e35b1d875e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081574 Jun 24 08:54:32.868650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 534/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:33.043084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:33.043629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:33.050791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.051240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.051996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.052429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.067722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:33.068640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:33.074595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.075037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.075794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.076221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.106828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9a1c2830-ca73-4ea3-adfd-f496282d0c89 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042947 Jun 24 08:54:33.107394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 535/1172] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:33.186694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:33.194674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3fb7ea7b-31e3-4a1d-8e8e-2b3b5f91bb37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155497 Jun 24 08:54:33.195250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 638/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:33.477930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:33.478761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:33.484723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.485166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.485949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.486376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.518305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3d68eeef-6b42-46dc-bc0b-e09fac97bb65 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044321 Jun 24 08:54:33.518868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 536/1174] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:33.884383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:33.884988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:33.891057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.891506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.892328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:33.892760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:33.952984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:33.961133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e70f719-ecd3-4bbf-b7f2-fe9102080c8c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080595 Jun 24 08:54:33.961680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 639/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:34.118637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:34.119554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:34.126098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.126543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.127810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.128237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.156928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fec408f1-e31c-489e-9ef0-58c34b0acebf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042163 Jun 24 08:54:34.157394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 537/1176] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:34.212761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:34.213391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:34.219841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.220280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.221086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.221515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.350246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:34.357852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d095877-84e9-4ed4-8bc0-3c45d66aae8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149059 Jun 24 08:54:34.358418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 640/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:34.530267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:34.531202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:34.537773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.538220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.538986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.539431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.568230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e5d57f10-cab9-484e-a5c3-6be0d21f51b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Jun 24 08:54:34.568790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 538/1178] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:34.977714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:34.978313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:34.984619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.985063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:34.985842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:34.986283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.052275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:35.059726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-41307d7a-70d0-415f-b513-e2738c92097a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085914 Jun 24 08:54:35.060286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 641/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:35.168530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:35.169475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:35.175880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.176319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.177076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.177504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.207927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7d85ce8b-8e65-4bd1-a127-07532bb0caa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Jun 24 08:54:35.208478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 539/1180] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:35.375797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:35.376412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:35.383611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.384061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.384832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.385301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.513683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:35.521723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06e99282-3680-48d1-99bd-487870c58416 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149926 Jun 24 08:54:35.522291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 642/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:35.579172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:35.580195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:35.586823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.587269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.588032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:35.588464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:35.616557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9dbcaa53-5bdf-4dda-a7b1-6088ff38609b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Jun 24 08:54:35.617118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 540/1182] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:36.076551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:36.077172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:36.083445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.084338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.084800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.085305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.147631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:36.155552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0e472f4f-8883-41b4-9abe-d19a4a0a032b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082873 Jun 24 08:54:36.156109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 643/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:36.220054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:36.221485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:36.228000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.228450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.229204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.229637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.258093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f033549a-20a6-43c3-b9b0-e4ec3e29755d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Jun 24 08:54:36.258640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 541/1184] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:36.539185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:36.539795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:36.546278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.546725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.547483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.547923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.629013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:36.629955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:36.635938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.636389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.637154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:36.637588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:36.667563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5c46e77d-435b-475a-8fce-4bd8b185a72a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Jun 24 08:54:36.668134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 542/1185] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:36.685019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:36.693118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aab3d49d-26ff-4efa-b2c5-dbe1016ea38b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157856 Jun 24 08:54:36.693682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 644/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:37.172520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:37.173128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:37.179733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.180179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.180926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.181355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.241931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:37.244099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:37.250939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b6f17618-32f4-46ac-958e-9d020bbf5e25 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082229 Jun 24 08:54:37.251504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 543/1187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:37.270068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:37.270992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:37.277187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.277627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.278407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.278837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.309124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-91798740-a6f4-4dc0-9ef4-a70da4389cb5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043546 Jun 24 08:54:37.309679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 645/1188] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:37.679397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:37.680320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:37.686274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.686715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.687470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.687899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.711316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:37.712024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:37.717643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-550f7f00-368a-466b-b3eb-a368cbe0f5d5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042127 Jun 24 08:54:37.718245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 544/1189] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:37.719042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.719660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.720429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:37.720857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:37.847909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:37.855316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1b302f7-5d84-4d1b-8eb8-9e94ad880c03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147789 Jun 24 08:54:37.855880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 646/1190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:38.267600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:38.268197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:38.275312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.275762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.276529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.320982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:38.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:38.327834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.328285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.329055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.329485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.342232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:38.349760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0629186-e1a6-4a44-9192-453f83112c61 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085963 Jun 24 08:54:38.350328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 545/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:38.359470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7c4f2c41-ad20-411d-9d9c-c250c63a4b06 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042303 Jun 24 08:54:38.360025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 647/1192] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:38.729006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:38.729955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:38.737055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.737499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.738301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.738732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.769380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-77710c4c-7e06-4632-8f01-cb350fa89da8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Jun 24 08:54:38.769946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 546/1193] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:38.872353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:38.872896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:38.879270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.879712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:38.880461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:38.880889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.010009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:39.017429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-23280341-0cc4-4fa5-9b2d-ed939204d2cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149061 Jun 24 08:54:39.018017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 648/1194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:39.366686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:39.367234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:39.370877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:39.371818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:39.373935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.374391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.375156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.375591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.377796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.378750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.379501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.379934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.406459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:39.412465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a900cb43-ff12-41ae-9368-65886e3f4e1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045482 Jun 24 08:54:39.413043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 649/1195] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:39.437559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:39.445732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1e933e0f-0767-4695-b681-d1f11e2cf216 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083089 Jun 24 08:54:39.446296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 547/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:39 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:39.781112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:39.782058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:39.788800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.789238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.790028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:39.790454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:39.818412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d35ad839-04da-4898-8660-5290ecb92939 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041529 Jun 24 08:54:39.818960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 650/1197] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:40.036329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:40.036848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:40.042800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.043242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.043993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.044421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.175977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:40.183874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3247a9a5-bc69-4626-8f5b-5e042bef2f79 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152015 Jun 24 08:54:40.184438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 548/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:40.424272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:40.425092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:40.431839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.432278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.433028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.433452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.462437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-70a880fa-e912-49a0-8297-b1b36473ce37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042190 Jun 24 08:54:40.462680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:40.463142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 651/1199] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:40.463244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:40.469579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.470053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.470809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.471240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.533094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:40.540620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f66a46b8-ea2d-457f-bb25-2a009b7e0f9c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081705 Jun 24 08:54:40.541186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 549/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:40 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:40.830100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:40.831024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:40.838060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.838501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.839254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:40.839694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:40.867445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3bbf4864-9a6d-445c-8720-0301ab3f5966 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041389 Jun 24 08:54:40.867991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 652/1201] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:41.201296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:41.201852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:41.208468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.208916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.209704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.210143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.345510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:41.353035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34d460db-ded3-4f09-9ea3-c5e0d27c917c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155696 Jun 24 08:54:41.353596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 550/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:41.474235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:41.475103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:41.481498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.481970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.482734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.483177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.512012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d3c489eb-3355-4f49-80b9-5c3a8051092f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041977 Jun 24 08:54:41.512563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 653/1203] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:41.557691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:41.558311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:41.564745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.565203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.566001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.566439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.637377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:41.644879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cb6c25fa-7a4e-4ea4-b523-5370e045bf0b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091121 Jun 24 08:54:41.645438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 551/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:41.878998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:41.880592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:41.886741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.887191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.887955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:41.888397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:41.916970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b9cb3fb1-9fbe-4f0f-a401-76754064dc38 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041940 Jun 24 08:54:41.917505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 654/1205] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:42.370600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:42.371206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:42.377265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.377782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.378544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.378975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.507673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:42.515121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-de7d0ebb-847a-464b-95eb-af2bb12e366f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148369 Jun 24 08:54:42.515679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 552/1206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:42.523925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:42.524835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:42.531566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.532038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.532792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.533215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.561711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6d78dfdc-712a-45ce-bf05-c6d3deea12eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042050 Jun 24 08:54:42.562285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 655/1207] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:42.661796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:42.662331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:42.668832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.669272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.670058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.670498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.732708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:42.740216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-704f4972-f88f-4080-86c8-69391884111b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082877 Jun 24 08:54:42.740806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 553/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:42 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:42.928541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:42.929396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:42.935331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.935772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.936520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:42.936962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:42.965562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d78a6b5e-0899-4b06-a5f9-3ba660f79eae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Jun 24 08:54:42.966215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 656/1209] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:43.532273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:43.532877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:43.539511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.539954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.540705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.541135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.573519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:43.574498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:43.580626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.581070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.581866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.582300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.613515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21539b30-96ca-4fd6-b0ce-057c3660180d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042662 Jun 24 08:54:43.613515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 657/1210] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:43.674832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:43.682954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e13efacb-8ec9-42bf-9552-6f9830c791f0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154482 Jun 24 08:54:43.683511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 554/1211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:43.756448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:43.757073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:43.763114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.763557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.764308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.764758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.824757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:43.832177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a8522afa-bc93-4e95-9404-e644e0ddca70 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079601 Jun 24 08:54:43.832740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 658/1212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:43.977137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:43.978126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:43.984109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.984561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:43.985333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:43.985794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.013524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e0adeee6-8804-45c3-ac6d-298a65379c84 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040991 Jun 24 08:54:44.014108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 555/1213] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:44.624679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:44.625611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:44.633638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.634112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.634898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.635336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.664343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-74aa2ec2-1428-4171-b3c0-f49c48de221a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043692 Jun 24 08:54:44.664904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 659/1214] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:44.700164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:44.700898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:44.707414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.708022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.709007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.709508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.838534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:44.847670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3225d4fa-9633-460e-b99d-f5c16efafa8d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151294 Jun 24 08:54:44.848331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 556/1215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:44.848714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:44.849334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:44.861369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.861860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.862677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:44.863171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:44.928684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:44.936195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8354fc91-eb39-4708-98ff-c4ebd7e41fe9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091415 Jun 24 08:54:44.936760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 660/1216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:45.025254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:45.026231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:45.033155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.033604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.034445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.034936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.069583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-145a4fa0-b8dd-4228-9c2d-685f7d292337 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048185 Jun 24 08:54:45.070192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 557/1217] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:45.676724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:45.677645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:45.684176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.684624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.685383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.685855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.715168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bbc8b413-7f59-4df6-94f6-500d20af6f49 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043038 Jun 24 08:54:45.715908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 661/1218] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:45.867080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:45.867613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:45.874155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.874645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.875416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.875881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.952893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:45.953500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:45.959490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.959938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:45.960696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:45.961131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.015946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:46.023546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-415ce881-fc58-4330-9f91-924a2db4edca tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161015 Jun 24 08:54:46.024227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 558/1219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:46.031754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:46.040053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-88bba242-2532-4ad6-b365-a2eaf8291028 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091048 Jun 24 08:54:46.040609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 662/1220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:46.081361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:46.082352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:46.088700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.089240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.090064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.090552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.119726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1191063d-714e-4398-b550-cc0fb9ecb9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042436 Jun 24 08:54:46.120195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 559/1221] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:46.727478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:46.728394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:46.734865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.735315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.736121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:46.736521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:46.765111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-712ede8a-16a9-477e-b61f-5da1d7d70725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042206 Jun 24 08:54:46.765652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 663/1222] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:47.040895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:47.041486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:47.047868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.048309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.049275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.051153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.056454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:47.057161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:47.063245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.063774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.064638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.065147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.065348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:47.152023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:47.160043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c6dba4cb-01d3-450e-8ed0-2cf19df7cb1a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.107510 Jun 24 08:54:47.161421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 664/1223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:47 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:47.170642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:47.173063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:47.179912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.180460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.181317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.181868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.212787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-da950f2b-461f-40ee-a0a3-f60525f929dc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Jun 24 08:54:47.213493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 665/1224] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:47.224526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:47.232230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dfd4a318-d7e0-4886-97ac-1658af8d8c6f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.195266 Jun 24 08:54:47.232804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 560/1225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:47.776518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:47.777767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:47.784195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.784641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.785398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:47.785855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:47.799407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:47.815969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cc915cc7-095d-4d60-883e-05551c244a15 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043446 Jun 24 08:54:47.817192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 666/1226] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:48.178426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:48.179034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:48.185412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.185894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.186662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.187096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.224999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:48.225963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:48.232159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.232606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.233378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.233846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.250636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:48.257983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b8e2317a-856e-4f5d-9f54-6ac053a174fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084320 Jun 24 08:54:48.258550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 561/1227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:48.262895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:48.263491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:48.263618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d5370b82-4118-421d-aaa1-cca40919eb90 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Jun 24 08:54:48.264208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 667/1228] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:48.270746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.271191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.271953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.272384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.409653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:48.417718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f6dd2239-3e0b-464e-a06a-1c5f72273a96 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158184 Jun 24 08:54:48.418344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 562/1229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:48.827605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:48.828712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:48.835749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.836200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.837232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:48.837655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:48.865780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-14cd46da-8727-4836-853a-ad3b54807afb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042212 Jun 24 08:54:48.866338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 668/1230] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:49.274518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:49.274801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:49.275416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:49.275890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:49.282195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.282641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.283408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.283835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.285279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.286126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.287513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.288302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.314423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f68bad96-6233-4a31-a494-72aa1a690330 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Jun 24 08:54:49.314981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 563/1231] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:49.349532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:49.357077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-610dcb0f-0919-46c0-8d2a-32f36a220809 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086407 Jun 24 08:54:49.357634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 669/1232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:49 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:49.434537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:49.435147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:49.441236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.442297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.443068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.443493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.570750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:49.578193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7fc10371-896c-42ed-ba63-29032d280a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147434 Jun 24 08:54:49.578763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 564/1233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:49.877718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:49.878562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:49.885049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.885492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.886285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:49.886719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:49.916868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a3f062d-2a23-4b1c-94bf-44dd6f82e4d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043287 Jun 24 08:54:49.917435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 670/1234] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:50.327026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:50.327951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:50.334417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.334858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.335611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.336039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.364672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-85a9a0c3-7c4c-4791-9f98-f0027c36b792 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041640 Jun 24 08:54:50.365302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 565/1235] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:50.374092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:50.375018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:50.381327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.381819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.382597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.383034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.443088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:50.450607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-04a8cc5d-288d-45ea-8fa2-9efd0d887f5d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080348 Jun 24 08:54:50.451171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 671/1236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:50.595547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:50.596080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:50.602667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.603115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.603883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.604316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.735548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:50.743108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3af06e10-884f-4908-817d-ce8cc697426c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151519 Jun 24 08:54:50.743670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 566/1237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:50.929305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:50.930179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:50.936659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.937109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.937940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:50.938375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:50.967324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d70d7c7-8925-4bce-bd46-25aff8416d24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042689 Jun 24 08:54:50.967877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 672/1238] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:51.375802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:51.376727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:51.383175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.383615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.384401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.384800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.414361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a80c1dcd-aada-489c-b289-591ec30a4a60 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042711 Jun 24 08:54:51.414917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 567/1239] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:51.467915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:51.468519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:51.475055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.475502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.476257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.476687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.540260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:51.547717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-205f05b5-9364-4936-9a72-3919dd2f4ab1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083638 Jun 24 08:54:51.548286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 673/1240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:51 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:51.759628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:51.760159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:51.766257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.766703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.767461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.767897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.899824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:51.907709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-62177ee3-26f4-4600-838c-9a12ab417ac2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151997 Jun 24 08:54:51.908254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 568/1241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:51.979536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:51.980466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:51.986920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.987372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:51.988192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:51.989271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.018360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5859f152-e75a-4125-bda0-0ce01c68d8c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042825 Jun 24 08:54:52.018908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 674/1242] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:52.426020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:52.426869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:52.433220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.433743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.434445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.434872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.462841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bf78a340-b181-46eb-b439-d2956928bf4e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Jun 24 08:54:52.463378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 569/1243] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:52.564471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:52.565078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:52.571114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.571565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.572325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.572763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.633035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:52.640649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5d780b36-5846-40ab-9917-90062a86c75b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080035 Jun 24 08:54:52.641208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 675/1244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:52 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:52.925364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:52.926036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:52.932030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.932474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:52.933223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:52.933651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.030854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:53.032128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:53.042167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.043007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.043618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.044048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.069510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:53.073626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21a52b05-baa1-467c-8d6c-0260d9f42e40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047359 Jun 24 08:54:53.074213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 676/1245] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:54:53.078401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8f78253-560b-48d3-8171-9b0b3623935a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156859 Jun 24 08:54:53.078957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 570/1246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:53.475010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:53.475923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:53.481864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.482310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.483062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.483490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.514932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a2c769c-c4a3-4a60-ad4c-90300c70bfbf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Jun 24 08:54:53.515766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 677/1247] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:53.657655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:53.658291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:53.665195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.665648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.666448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:53.666883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:53.730924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:53.738584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c35a75a2-8058-46bf-bdcd-fa393e2146d7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084849 Jun 24 08:54:53.739192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 571/1248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:54.085246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:54.086218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:54.092807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.093254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.094045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.094479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.095610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:54.096208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:54.102222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.102670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.103438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.103874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.123351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-00497cc0-70fd-4e45-8671-184c87b2b24b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042633 Jun 24 08:54:54.123905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 678/1249] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:54.234396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:54.241986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1f843898-0dd2-4226-abf2-d83ea667c079 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150120 Jun 24 08:54:54.242552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 572/1250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:54.527302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:54.528347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:54.534438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.534889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.535668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.536097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.565074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a8abff5c-89c8-4982-98fa-445e1584c839 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jun 24 08:54:54.565630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 679/1251] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:54.755946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:54.756526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:54.763012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.763466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.764228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:54.764696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:54.826638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:54.834829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3cc86544-6434-46af-9631-56d21b560b53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083277 Jun 24 08:54:54.835399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 573/1252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:55.135520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:55.136440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:55.142902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.143349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.144100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.145033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.174161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d88ac946-06ef-414f-b801-e83b368d203a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042639 Jun 24 08:54:55.174719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 680/1253] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:55.262563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:55.263174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:55.269139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.269583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.270377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.270811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.409601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:55.417570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2b31d320-f323-46be-8f58-633800fe5666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158851 Jun 24 08:54:55.418157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 574/1254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:55.576749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:55.577688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:55.583888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.584332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.585084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.585512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.614590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ddd8c626-f915-4cb8-ad39-30a4fb697c89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041884 Jun 24 08:54:55.615153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 681/1255] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:55.852087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:55.852699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:55.859210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.859656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.860416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:55.860846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:55.922400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:55.929986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ab26481c-d6d3-48a4-b983-59ed23c7199a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082304 Jun 24 08:54:55.930545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 575/1256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:55 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:56.186782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:56.187612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:56.194276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.194746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.195505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.195931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.225172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bb522cba-5578-4f78-ad4c-44fef665d37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042647 Jun 24 08:54:56.225734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 682/1257] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:56.437098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:56.437615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:56.444977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.445423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.446223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.446659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.577868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:56.585958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a4ffd7be-244c-494d-93d2-8d5e83a40ad8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153933 Jun 24 08:54:56.586583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 576/1258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:56.625689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:56.626630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:56.632624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.633072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.633867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.634311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.636642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:56.664499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12080a02-68d5-49e2-9fe3-95260e066a1b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042811 Jun 24 08:54:56.665058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 683/1259] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:56.946792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:56.947409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:56.953846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.954300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.955070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:56.955511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:56.959896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:57.016233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:57.024401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78e242d1-eeef-460f-beab-6e140b40d517 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081547 Jun 24 08:54:57.024962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 577/1260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:56 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:57.236533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:57.237375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:57.243896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.244344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.245101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.245533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.274896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b9a5baca-4713-41be-8664-21c1deb6cb90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042438 Jun 24 08:54:57.275442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 684/1261] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:57.603612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:57.604212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:57.610319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.610761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.611939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.611939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.675732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:57.677182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:57.683106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.683543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.684303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:57.684729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:57.715559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-43d61ff7-63a2-45ca-b46d-5a64d3a6b2b0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Jun 24 08:54:57.716448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 685/1262] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:57.747249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:57.754091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-105f5eaa-0047-4e97-b085-866a7f64ca93 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154249 Jun 24 08:54:57.754660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 578/1263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:58.041971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:58.042614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:58.044479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:58.049679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.050134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.051530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.051973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.111637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:58.119081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fcd4fe3-f456-4a4e-8e04-f779041c81d0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081106 Jun 24 08:54:58.119648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 686/1264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:58.287756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:58.288676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:58.295228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.295625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.296384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.296815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.324761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e44427b-5f76-467f-9e61-9f31469faa37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041660 Jun 24 08:54:58.325310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 579/1265] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:58.727862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:58.728796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:58.735534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.736090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.736796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.737238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.768967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a05428e5-a8d0-4b71-847d-deb9beab0089 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Jun 24 08:54:58.769546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 687/1266] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:54:58.771870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:58.772486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:58.778980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.779430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.780203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:58.780642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:58.915869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:58.923717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f2472a2e-fa96-4d3e-afd5-3d34ca7ab68d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156149 Jun 24 08:54:58.924308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 580/1267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:54:59.136454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:59.136970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:59.143323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.143770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.144536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.145688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.206975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:54:59.215228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6d8cc24a-372d-4f78-bed0-8f6944926d54 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082794 Jun 24 08:54:59.215806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 688/1268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:59 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:54:59.336658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:59.337583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:59.339887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:59.345081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.345534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.346356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.346768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.376887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3753abf2-db17-4199-b361-7966b76e5c51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044301 Jun 24 08:54:59.377445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 581/1269] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:54:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:54:59.781464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:59.782437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:59.789358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.789843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.790599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.791027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.819779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-70a1bf85-638d-4ea7-8290-0363c2b91178 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042270 Jun 24 08:54:59.820321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 689/1270] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:54:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:54:59.940403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:54:59.940921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:54:59.947610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.948038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:54:59.948799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:54:59.949224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.234518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:00.234854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:00.235132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:00.241228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.241695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.242476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.242735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-719149a7-436d-4982-b481-2f3095181f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.306250 Jun 24 08:55:00.242907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.243301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 582/1271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:54:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:00.310664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:00.318495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-acf8c7d4-cbe1-44b2-bd02-1bd4c68b18df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.089398 Jun 24 08:55:00.319083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 690/1272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:00.388553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:00.389480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:00.396635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.397083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.397890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.398317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.427896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10136df5-e980-4003-898d-5efe4336b042 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043278 Jun 24 08:55:00.428457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 583/1273] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:00.831421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:00.833005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:00.839845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.840291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.841061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:00.841489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:00.870769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7023670c-1823-42f6-8026-a425ba53e2c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043252 Jun 24 08:55:00.871327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 691/1274] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:01.260630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.261184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.267250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.267694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.268446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.268873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.337859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.338544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.344700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.345152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.345965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.346400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.414943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:01.422758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5a323e6-c1d8-47cd-b498-7f0535754997 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088886 Jun 24 08:55:01.423589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 692/1275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:01.439789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.440734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.441793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:01.447021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.447477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.448259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.448696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.449397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dd0d938c-8b40-4632-bb0e-e118f2a2c4e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.192619 Jun 24 08:55:01.450003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 584/1276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:01.479506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9b47cfbf-9885-4d82-aa25-ac7e595fcef3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043780 Jun 24 08:55:01.480087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 693/1277] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:01.882532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:01.883388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:01.889531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.890020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.890794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:01.891228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:01.920589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5e0b1bc3-8425-410a-bb54-045a7cfa4e71 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 Jun 24 08:55:01.921125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 585/1278] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:02.440242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:02.440849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:02.448312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.448780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.449543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.450006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.466612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:02.467231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:02.473704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.474205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.474996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.475436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.516079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:02.524787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2383a369-a345-4667-a13a-a069a4db6b45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088368 Jun 24 08:55:02.525371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 694/1279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:02 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:02.530674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:02.531603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:02.538269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.538723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.539537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.541119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.576500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f7b4b2c-9ea5-4e89-a597-6ef06300c81a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050009 Jun 24 08:55:02.577086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 695/1280] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:02.619537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:02.628959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7b1ca941-b847-4d34-bb93-52c5198cc29e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.166206 Jun 24 08:55:02.629523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 586/1281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:02.932982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:02.933927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:02.939904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.940347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.941104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:02.941532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:02.970536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eb63ed46-ae81-45a4-ba00-4a77c358a239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041530 Jun 24 08:55:02.971075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 696/1282] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:03.542541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:03.543213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:03.549672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.550143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.550918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.551360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.587683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:03.588607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:03.595070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.595512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.596285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.596718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.613448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:03.621118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c2c4a0db-2328-46c4-ad08-73657cc5dd53 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082447 Jun 24 08:55:03.621700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 587/1283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:03 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:03.631952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-213cb5af-2f00-445d-9bb0-a0ca0dcd750a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048607 Jun 24 08:55:03.632505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 697/1284] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:03.649000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:03.649632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:03.655854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.656300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.657125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.657561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.791181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:03.800740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-551115a6-00d7-4da9-98f2-c8065ccc47ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154158 Jun 24 08:55:03.800740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 588/1285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:03.982760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:03.983705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:03.990112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.990574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:03.991382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:03.991823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.021909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a35c276d-06fb-4e63-a01b-6719a5c6dab9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042994 Jun 24 08:55:04.023358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 698/1286] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:04.638138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:04.638739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:04.643960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:04.644898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:04.647272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.648066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.649458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.650294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.652380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.652836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.659124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.659124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.681122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:04.689934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b1d1847-6ab1-4e85-b863-ce6b071a8c44 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050072 Jun 24 08:55:04.690531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 699/1287] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:04.723111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:04.733507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fe2c0604-4d15-4970-8d5d-6677d64a7b64 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098951 Jun 24 08:55:04.734253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 589/1288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:04 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:04.816056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:04.816685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:04.823157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.823610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.824442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:04.824830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:04.967242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:04.975620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-865151a0-5a61-4237-8e09-8e723d7576d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163002 Jun 24 08:55:04.976189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 700/1289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:05.034880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.035816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:05.042604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.043036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.043813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.044253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.072533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b7254f86-5b4c-488e-b76b-77fd3374484d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041920 Jun 24 08:55:05.073221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 590/1290] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:05.703562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.704485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:05.710988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.711432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.712187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.712615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.742678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9abca02a-103d-4092-ba2b-f7e529efd6cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044123 Jun 24 08:55:05.743231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 701/1291] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:05.752819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.753517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:05.760699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.761147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.761951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:05.762427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:05.823181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:05.830720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e0af5f17-b675-4daf-a180-14e8c1d570f0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082228 Jun 24 08:55:05.831276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 591/1292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:05.993783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:05.994294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.000298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.000740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.001491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.001949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.083998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:06.084996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.092776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.093215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.094115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.094571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.125278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5e196394-523a-489e-8216-fda90af435cb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045563 Jun 24 08:55:06.125857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 592/1293] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:06.134690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:06.142158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-55d77414-c2d1-4f3c-a6c2-c3587a0401e3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152991 Jun 24 08:55:06.142719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 702/1294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:06.754668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:06.755540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.762974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.763438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.764242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.764679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.790982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:06.796286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-adbb9ed2-fd01-4de0-9007-424fe830a0af tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045735 Jun 24 08:55:06.796886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 593/1295] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:06.848310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:06.848945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:06.856015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.856403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.857150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:06.857587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:06.921709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:06.929444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f9c4499e-9834-416f-a758-944bfb2d5cff tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085785 Jun 24 08:55:06.930089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 703/1296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:07.137364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:07.138323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:07.144241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.144694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.145500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.145927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.158782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:07.159391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:07.165516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.165984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.166758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.167193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.174714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-70af7108-caf9-45de-8c8d-faa3872c3d1e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041459 Jun 24 08:55:07.175279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 594/1297] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:07.293315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:07.300914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2886e44-f93e-43ac-8d90-13cf8497b4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.145949 Jun 24 08:55:07.301477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 704/1298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:07.809243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:07.810198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:07.816877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.817325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.818121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.818558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.847281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e7cf991b-c05e-413f-8959-a462a0917d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042106 Jun 24 08:55:07.847825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 595/1299] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:07.946595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:07.947126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:07.953507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.954050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:07.954805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:07.955238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.018881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:08.027663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bdea7b5a-9759-499b-ab35-72a91e0a9fe7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085181 Jun 24 08:55:08.028252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 705/1300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:08.187065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:08.188000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:08.194912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.195359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.196133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.196568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.230469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1872d71e-4fbf-46ad-a59e-d3fed12f58c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Jun 24 08:55:08.230947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 596/1301] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:08.321729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:08.322859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:08.333724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.335110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.336508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.337327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.510112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:08.517835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dc49ea93-1511-4855-977f-9468540fa7ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.203005 Jun 24 08:55:08.518404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 706/1302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:08.858846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:08.859812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:08.867120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.867577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.868370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:08.868844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:08.900167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7853125b-de38-4f52-93a8-b501ac95c9f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045305 Jun 24 08:55:08.900747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 597/1303] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:09.044526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:09.045114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:09.051645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.052083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.053539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.053994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.117332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:09.124958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d02a73aa-f5c7-4e93-b24f-876788cef3cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084341 Jun 24 08:55:09.125529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 707/1304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:09 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:09.242844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:09.243814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:09.249920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.250375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.251149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.251591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.281204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-89e4d9b1-0887-4fe0-bc55-fdcb555a2b6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042997 Jun 24 08:55:09.281798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 598/1305] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:09.536401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:09.537036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:09.543778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.544220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.544980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.545404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.681182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:09.688870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e93bca7-23aa-4637-9d2f-26fc09b9f666 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156507 Jun 24 08:55:09.689441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 708/1306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:09.912516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:09.913601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:09.920724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.921301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.922246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:09.922775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:09.953924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-84adefe3-0a83-4b0c-8882-7e1146cc4c60 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045717 Jun 24 08:55:09.954477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 599/1307] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:10.141405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:10.142512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:10.148798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.149257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.150065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.150506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.215192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:10.223669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8bcd6fec-844e-4b72-b5bf-67b54cb308d6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086111 Jun 24 08:55:10.224242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 709/1308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:10.292121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:10.293083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:10.299436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.299884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.300706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.301136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.332289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8742506d-9478-479e-9210-bb4065940816 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Jun 24 08:55:10.332880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 600/1309] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:10.706823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:10.707437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:10.713683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.714144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.714937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.715378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.850862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:10.858999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e26d2af-fab1-4b65-acfc-e165f1a0697e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156187 Jun 24 08:55:10.859565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 710/1310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:10.966314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:10.967237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:10.974525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.975724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:10.976602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:10.977135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.006173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e385915-b954-4193-8e8f-940aa61c4ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043804 Jun 24 08:55:11.006728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 601/1311] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:11.241383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:11.241978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:11.248478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.248922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.249765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.250200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.318448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:11.327411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3fc772ba-7e0d-4578-a9cd-04d641b19261 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.090893 Jun 24 08:55:11.327995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 711/1312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:11.344314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:11.345312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:11.352746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.353194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.354042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.354480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.401413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34c86aeb-448a-43c4-96be-7296931865ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061254 Jun 24 08:55:11.402057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 602/1313] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:11.877616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:11.878303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:11.886248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.886699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:11.887485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:11.887922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.018910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:12.019862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:12.027990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.028437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.029449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.029935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.048047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:12.056553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-97c8e451-d9e7-4fce-80a4-43a51ee76153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.184002 Jun 24 08:55:12.057349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 712/1314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:12.065081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fe8e6bc2-c09c-433f-bfc5-04d3f4a957d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050841 Jun 24 08:55:12.065696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 603/1315] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:12.351481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:12.352088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:12.358599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.359051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.359822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.360265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.413418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:12.414498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:12.420973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.421504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.422799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:12.422957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:12.425312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:12.434665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37a13d75-4a70-4d4a-b720-98a6be25ecdf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087088 Jun 24 08:55:12.435255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 713/1316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:12.461567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ba1e91da-290a-46ca-8e91-5af74e2e94ad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052136 Jun 24 08:55:12.462205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 604/1317] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:13.076966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.077464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.077996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.078447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.086392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.086648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.086840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.087087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.087621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.087877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.088045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.088332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.120230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6dcf2c40-0f5d-4199-88f5-f27ae6dd7b28 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046752 Jun 24 08:55:13.120816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 605/1318] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:13.240144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:13.249007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-31c90c21-2a80-4807-a9f0-4569d10c5f95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.178320 Jun 24 08:55:13.249601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 714/1319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:13.452585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.453107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.459882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.460335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.461109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.461545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.472754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:13.473687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:13.480676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.480676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.481184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:13.481610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:13.514536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-44046dc6-47ee-47f0-be89-72db4b2a52bc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Jun 24 08:55:13.515113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 715/1320] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:13.526806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:13.534496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7c4e12e5-391c-47b8-bc91-7d2b8f808047 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085927 Jun 24 08:55:13.535067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 606/1321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:13 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:14.134213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.135847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.142739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.143359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.144124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.144553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.160456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:14.176639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4c25043a-8b4c-45c8-b968-efa89964729c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048359 Jun 24 08:55:14.177196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 716/1322] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:14.265941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.266539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.273701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.274147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.274917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.275468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.403622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:14.411040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9768b200-7ab2-436b-991c-f0181f5b22e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149170 Jun 24 08:55:14.411597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 607/1323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:14.527166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.528164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.534952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.535401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.536147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.536674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.550617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:14.551240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:14.557755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.558216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.558993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:14.559431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:14.566848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6106a58f-3658-40d1-b3ae-d29d2f6940cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044087 Jun 24 08:55:14.567418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 717/1324] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:14.622214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:14.630104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d47cb563-22cc-4e82-84fb-86ccfc933f7c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083220 Jun 24 08:55:14.631325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 608/1325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:15.188434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:15.189351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.195872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.196356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.197119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.197552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.226364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b2d4a06f-a9ee-4222-8a3d-80063c691665 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041910 Jun 24 08:55:15.227011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 718/1326] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:15.428343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:15.429045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.437780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.438227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.439056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.439441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.568277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:15.576458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2e4b4006-d46f-4c4c-a6a6-4b208c9b500f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152035 Jun 24 08:55:15.577142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 609/1327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:15.579043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:15.580112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.586882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.587332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.588092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.588526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.618137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e3c5c26-6e33-459e-a9f6-4f0bb3ae508b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042980 Jun 24 08:55:15.618700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 719/1328] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:15.648192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:15.651393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:15.655725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.656178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.657041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:15.657387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:15.672955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:15.719879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:15.727596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8ba5e35-59ca-4ef6-87ee-1baed2bf7924 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084297 Jun 24 08:55:15.728273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 610/1329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:15 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:16.238671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:16.239594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:16.246955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.247404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.248172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.248606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.278376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-36bce3ac-7551-48a7-9c13-6cf08a322310 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043874 Jun 24 08:55:16.278937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 720/1330] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:16.593343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:16.593996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:16.601427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.601896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.602666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.603106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.629269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:16.630938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:16.636939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.637380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.638175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.638618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.668833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c6545119-fc23-4657-a441-e0ae62ff4ff8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jun 24 08:55:16.669413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 721/1331] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:16.740596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:16.744975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:16.745607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:16.748375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d377f1c1-9699-4c98-96ec-6f1c462517c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158834 Jun 24 08:55:16.748952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 611/1332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:16.751762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.752205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.752965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:16.753440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:16.815086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:16.822628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3a23f6c7-585a-45f5-94d1-49506c0b67ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081528 Jun 24 08:55:16.823190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 722/1333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:16 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:17.290223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:17.291174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:17.297365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.297853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.298851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.299281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.329961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-93d7f0ff-6980-456b-99ae-edec40770d8b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043683 Jun 24 08:55:17.330523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 612/1334] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:17.681028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:17.682036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:17.688500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.688950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.689731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.690163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.718698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0721f574-784e-48a6-bf92-eff584398ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 Jun 24 08:55:17.719266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 723/1335] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:17.765450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:17.766105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:17.772714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.773152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.773938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.774370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.838926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:17.839541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:17.845545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.846052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.846824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:17.847263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:17.917173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:17.924986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cb9e3237-a288-4c77-999f-9909670b1274 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.089957 Jun 24 08:55:17.925566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 724/1336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:17.940906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:17.948968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0d9a5248-f7d6-42d9-8bc7-42eccbd99fed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.187303 Jun 24 08:55:17.949527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 613/1337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:18.342465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.343444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:18.350166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.350611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.351372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.351807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.380837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e657d338-a6bd-4a55-bbed-26d607d1ded3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042268 Jun 24 08:55:18.381395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 725/1338] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:18.730360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.731298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:18.737906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.738360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.739138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.739571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.769042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-21ab723d-7432-4742-a267-fcb6df33bdc1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Jun 24 08:55:18.769864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 614/1339] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:18.942849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.943992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:18.950470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.950921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.951690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.952128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.965979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:18.966586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:18.972918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.973359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:18.974167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:18.974644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:19.016067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:19.024704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7107971c-d896-40c0-8006-bed5d0abdad6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085752 Jun 24 08:55:19.025301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 726/1340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:19.116955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:19.124639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-67ced539-594f-491f-9565-3095fa25a83f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.162565 Jun 24 08:55:19.125207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 615/1341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:19.392578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:19.393524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:19.399551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:19.399999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:19.401024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:19.401452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:19.430918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-706ca7ea-455c-45ad-9b5d-50297df0c7be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042356 Jun 24 08:55:19.431471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 727/1342] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:19.781141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:19.782099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:19.788603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:19.789049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:19.789846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:19.790275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:19.827482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8996e4af-4c39-485b-85c6-7c5fadcb23ef tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050440 Jun 24 08:55:19.828052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 616/1343] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:20.042461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:20.043018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:20.049864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.050260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.051033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.051462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.112357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:20.119888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-78098fa9-1630-4cb0-9930-0b8da03aea4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081437 Jun 24 08:55:20.120605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 728/1344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:20.142087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:20.142701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:20.149178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.149630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.150415 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.151101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.281754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:20.289241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-69a0ee8d-d3fb-48fb-9dfb-e3a3b2ebc947 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150998 Jun 24 08:55:20.289831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 617/1345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:20.443674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:20.444571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:20.450744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.451189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.451954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.452380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.481760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8aa5b962-aa5a-4d7f-b6df-d588f691c623 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042674 Jun 24 08:55:20.482314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 729/1346] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:20.839716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:20.840648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:20.847170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.848479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.848479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:20.848901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:20.881879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b690bdaf-a9a6-4d70-a14f-9c95034deb9a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Jun 24 08:55:20.882444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 618/1347] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:21.137814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:21.138386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:21.144789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.145237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.146040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.147049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.208538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:21.216781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de36b1cf-5c3e-41c1-b1f4-826398852935 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083080 Jun 24 08:55:21.217343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 730/1348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:21.307640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:21.308242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:21.314618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.315063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.315824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.316252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.451097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:21.458891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-36f4e259-3030-41b0-a3b4-ee3f77bc5d75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155084 Jun 24 08:55:21.459448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 619/1349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:21.493471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:21.494664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:21.500843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.501283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.502074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.502500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.533410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-826af6ea-a5bb-4fe0-918e-776c0d41ccaf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044507 Jun 24 08:55:21.533992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 731/1350] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:21.892634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:21.893564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:21.900193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.900911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.901766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:21.902356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:21.933526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1a7f06a7-58d6-4ae7-afba-874812cedc74 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Jun 24 08:55:21.934205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 620/1351] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:22.233950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:22.234501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:22.241257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.241762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.242536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.242967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.307063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:22.314987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cd785b6f-2054-496b-8bc4-922fb2729bef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084957 Jun 24 08:55:22.315585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 732/1352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:22 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:22.476272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:22.476915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:22.483197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.483643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.484476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.484855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.545504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:22.546473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:22.552764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.554571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.555452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.556128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.560245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:22.588887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cf24b565-0069-4333-904a-d26814a22462 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047618 Jun 24 08:55:22.589484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 733/1353] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:22.624074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:22.632505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-97855f82-68e2-4cbf-a768-5bd94bf2fb89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160159 Jun 24 08:55:22.633279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 621/1354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:22.945183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:22.946136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:22.952191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.952632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.953390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:22.953855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:22.985094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-090c1b17-897d-4112-876e-c9a8ba3c7468 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Jun 24 08:55:22.985703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 734/1355] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:23.331817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.332420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.338996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.339442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.340196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.340629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.401339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:23.408774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3105ff88-de13-4894-a8df-11ca7a539862 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080963 Jun 24 08:55:23.409361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 622/1356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:23.601751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.602587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.609046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.609496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.610305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.610736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.639281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8c1c6742-2d46-4ab0-9a92-317182000fa3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042326 Jun 24 08:55:23.639838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 735/1357] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:23.650390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.651567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.657605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.658069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.659134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:23.659571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:23.791570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:23.798994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b766149-2348-43e4-a4b8-22574f74ab11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153206 Jun 24 08:55:23.799548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 623/1358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:23.996961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:23.997835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:23.999940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:24.005905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.006344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.007111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.007543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.037948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cb94dda6-c40e-41c1-8d20-7b7e8c2d9f02 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Jun 24 08:55:24.038506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 736/1359] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:24.425042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:24.425655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:24.432717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.433169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.433964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.434404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.495256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:24.502818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e40f73fc-730b-4daf-84ab-2dac3a4fe690 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081687 Jun 24 08:55:24.503382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 624/1360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:24.651805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:24.652742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:24.659377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.659825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.660591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.661016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.690516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-954b28ed-3277-41cb-ae95-0d24adcad255 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042979 Jun 24 08:55:24.690997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 737/1361] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:24.816121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:24.816721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:24.823595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.824044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.824800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:24.825231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:24.956977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:24.965390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-225278b2-785c-46fc-9786-215f96dc1697 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153143 Jun 24 08:55:24.966009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 625/1362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:25.049592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:25.050598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:25.057003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.057452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.058243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.058676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.086772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dabcd68a-cefa-46dd-9ba8-e74bb38e4ddc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041220 Jun 24 08:55:25.087317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 738/1363] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:25.520146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:25.520801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:25.527631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.528080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.528849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.529314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.589361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:25.596890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5d285d33-083f-4469-b345-fc7d15575536 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080639 Jun 24 08:55:25.597456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 626/1364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:25.702697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:25.703654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:25.710213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.710659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.711423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.711859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.744708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3b5c5a26-c5da-4f35-9f72-72c20a4c8df4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045948 Jun 24 08:55:25.745260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 739/1365] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:25.983398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:25.984005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:25.990260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.990717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.991490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:25.991928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:25.994564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:26.099850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:26.100785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:26.106847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.107293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.108055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.108501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.124688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:26.132878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0aa18761-333e-49ea-8ecf-c1b505aeac2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153351 Jun 24 08:55:26.133442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 627/1366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:26.137309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b97e4bd9-e575-49ac-8b48-e90e1dc60a62 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Jun 24 08:55:26.137884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 740/1367] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:26.614175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:26.614785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:26.621994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.622443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.623205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.623749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.684677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:26.692230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eec97efa-06eb-4993-ac85-94bb7cbcb55c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081924 Jun 24 08:55:26.692812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 628/1368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:26.755985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:26.756898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:26.763354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.763713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.764460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:26.764888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:26.795057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-22d091b0-bbd7-4715-aeac-a7d857c185c7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043043 Jun 24 08:55:26.795604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 741/1369] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:27.149698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.150791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.150926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.151447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.156717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.157167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.157324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.157806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.157951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.158375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.158565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.158996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.187355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-949e6ef2-f859-47f2-8710-a73c2238a89c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 Jun 24 08:55:27.187928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 629/1370] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:27.291918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:27.299323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8e7d814c-dde7-4a9d-9e5f-4049ab06b8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153130 Jun 24 08:55:27.299887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 742/1371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:27.708525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.709307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.716342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.716798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.717574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.718088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.780673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:27.789205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-94b44659-f2b5-487e-a416-8a3fd2169b86 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084471 Jun 24 08:55:27.789991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 630/1372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:27.807339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:27.808264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:27.815169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.815618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.816388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:27.816818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:27.848861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-670f5043-f8e6-4724-8a68-04bc9cba05f4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045994 Jun 24 08:55:27.850283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 743/1373] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:28.200283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.201207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.203079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:28.209287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.209832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.210595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.211025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.239880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5293cccd-cd1b-4cb5-9b96-228940ac3b25 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Jun 24 08:55:28.240439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 631/1374] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:28.316929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.317533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.323570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.324021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.324802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.325227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.456729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:28.464834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-452d3cb4-d651-4e54-8d87-012fbc7ee9a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151774 Jun 24 08:55:28.465391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 744/1375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:28.806565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.807175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.813624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.814105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.814872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.815302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.861096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:28.862197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:28.869438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.869924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.870705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:28.871139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:28.902525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ea2aa96b-90d9-4ed5-9580-d04a65fec770 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045362 Jun 24 08:55:28.903354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 745/1376] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:29.115565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:29.123132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9e5b2c9a-33d5-4c8b-b04b-3b817e68f73a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.321064 Jun 24 08:55:29.123695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 632/1377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:28 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:29.251581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:29.252495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:29.258449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.258895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.259642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.260071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.288645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c0fc14b0-f128-4505-af14-54a2e78737d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Jun 24 08:55:29.289212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 746/1378] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:29.482430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:29.482961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:29.488999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.489448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.490847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.491281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.627568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:29.635098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-44c4ac1e-ef65-48d6-ad1b-2d43dd8faa01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156646 Jun 24 08:55:29.635665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 633/1379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:29.914481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:29.915455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:29.922216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.922664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.923450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:29.923885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:29.953044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fbd3148f-99c7-4ecb-9488-a62c5cfe87c6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043275 Jun 24 08:55:29.953598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 747/1380] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:30.140194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.140801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.147931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.148379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.149145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.149584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.211261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:30.218806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-52c88d30-2697-48ac-9ab6-d5c88209ea72 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082449 Jun 24 08:55:30.219365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 634/1381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:30.300355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.301300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.307911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.308365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.309119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.309554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.339580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1781bb8a-86ff-454f-9e11-5c159a493239 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043203 Jun 24 08:55:30.340173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 748/1382] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:30.653092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.653745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.659727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.660173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.660935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.661361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.793449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:30.801883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b147715c-80f6-4889-a843-c2d636cc78a1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152829 Jun 24 08:55:30.802459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 635/1383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:30.965322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:30.966293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:30.973028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.973473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.974287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:30.974742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:30.998935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:31.005373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fa60e9e-f932-4a70-ba1b-bb0f2d99b116 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044108 Jun 24 08:55:31.006605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 749/1384] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:31.198381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:55:31.198645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 08:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:55:31.236115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.236764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.244087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.244534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.245333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.245827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.305897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:31.313363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-332f144e-be47-4088-9092-0f7934a89655 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081669 Jun 24 08:55:31.313892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 636/1385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:31.351943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.353013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.359423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.359899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.360687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.361135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.390042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6a4ea439-be83-4c25-82b5-dd9cdf94a2ae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042423 Jun 24 08:55:31.390636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 750/1386] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:31.819659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:31.820288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:31.826579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.827035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.827811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:31.828274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:31.964559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:31.972083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f67619b3-4453-4389-962e-9099b80f8a2e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156947 Jun 24 08:55:31.972647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 637/1387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:32.017972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:32.018893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:32.025578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.026058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.026849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.027282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.057087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4064b8f7-d354-4204-846b-cdfa491a2dc1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043135 Jun 24 08:55:32.057624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 751/1388] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:32.330545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:32.331177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:32.337851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.338304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.339062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.339492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.399609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:32.402343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:32.403295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:32.407432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-69216456-d3e0-45de-b848-f3037d61ee7b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080721 Jun 24 08:55:32.407992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 638/1389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:32.409176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.409620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.410407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.410837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.439967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-840fc9ee-a5e4-4188-bb39-86f0dd1ab6cd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042052 Jun 24 08:55:32.440510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 752/1390] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:32.989705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:32.990833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:32.996882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.997326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:32.998117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:32.998544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.068491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:33.069460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:33.075938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.076440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.077756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.078559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.109915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-11a5405f-119f-4cc5-b347-f7ff4a98fb20 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045307 Jun 24 08:55:33.110497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 753/1391] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:33.128083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:33.135546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-35df43a8-3725-4ea3-8855-1ec5c27cea89 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150276 Jun 24 08:55:33.136106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 639/1392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:33.424740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:33.425375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:33.431441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.431890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.432654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.433088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.452305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:33.453354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:33.461053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.461500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.462305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:33.462741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:33.494097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:33.494989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ceab976e-4e53-490d-b928-dd75520a611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046925 Jun 24 08:55:33.495588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 640/1393] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:33.502302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d05f469-1fc8-4401-b1a6-e4fe0d7aff2e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081390 Jun 24 08:55:33.502875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 754/1394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:34.122271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:34.123198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:34.129225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.129711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.130482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.131634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.152429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:34.153123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:34.159609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.160064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.160514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3c7f357c-2a80-480b-b330-66b9a802461e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042213 Jun 24 08:55:34.160836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.161092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 641/1395] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:34.161263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.291972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:34.299405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-11289dd0-3f38-4e44-b63d-8e5e8ffee267 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151058 Jun 24 08:55:34.299958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 755/1396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:34.510231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:34.511165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:34.517957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.518406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.519175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.519493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:34.519616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.520002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:34.527130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.527582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.528340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:34.528768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:34.549482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-59f5346f-57de-4131-83e2-0fe0e3258361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Jun 24 08:55:34.549996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 642/1397] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:34.588690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:34.596115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3225bfcb-fa23-498a-919e-540bbf1aada4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080526 Jun 24 08:55:34.596669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 756/1398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:35.172791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:35.173620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:35.180964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.181409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.182207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.182646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.212818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:35.217653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1aecdcae-3259-47a8-8901-0eb4e3cf5244 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049047 Jun 24 08:55:35.218226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 643/1399] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:35.316960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:35.317565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:35.324144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.324587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.325346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.325814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.456212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:35.463668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07491abb-f8d2-4d16-a789-8c544453c348 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150605 Jun 24 08:55:35.464231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 757/1400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:35.561290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:35.562285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:35.568663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.569146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.570044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.570723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.601727 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b78c372-3f75-42a3-b2ef-1403bf163aca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Jun 24 08:55:35.602285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 644/1401] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:35.612103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:35.612706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:35.618839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.619286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.620039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:35.620470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:35.680118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:35.687525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c872a962-8908-49a1-977b-a742fe9a9149 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079265 Jun 24 08:55:35.688078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 758/1402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:35 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:36.229450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.230429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.236460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.236906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.237683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.238126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.267800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-848c646d-3e41-4576-8c28-4d71da8b6c95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042325 Jun 24 08:55:36.268350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 645/1403] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:36.480300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.480900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.487614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.488053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.488800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.489227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.613071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.614036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.617813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:36.621021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.621464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.622259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.622690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.625479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4fa11a88-85c4-4c2c-a9f4-c04589ac46c9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149079 Jun 24 08:55:36.626195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 759/1404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:36.653219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-91f15512-04e4-4e4d-885e-8980a768fe3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Jun 24 08:55:36.653739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 646/1405] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:36.703979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:36.704593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:36.710641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.711095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.711859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:36.712297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:36.772106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:36.780023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3cd4c640-86db-4e05-9ad1-e4a9016afa50 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079899 Jun 24 08:55:36.780611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 760/1406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:37.280785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:37.281728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:37.287724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.288168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.288916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.289344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.317588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-47215013-a33c-425a-8749-e5f9c22746bc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041169 Jun 24 08:55:37.318817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 647/1407] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:37.643526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:37.644131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:37.650932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.651375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.652127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.652556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.664952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:37.665907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:37.672295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.672736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.673503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.673965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.703163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7b4b35f9-cef8-4a20-960f-fef7f34bb415 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 Jun 24 08:55:37.703741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 648/1408] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:37.785144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:37.793683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-75fa3fce-c904-466a-a35e-7457a39237d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153947 Jun 24 08:55:37.794251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 761/1409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:37.797460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:37.798104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:37.803995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.804441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.805227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:37.805675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:37.865397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:37.872860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ec92fbd-d216-4e9e-aa8d-4866da8e69a2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079174 Jun 24 08:55:37.873418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 649/1410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:38.330025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:38.330933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:38.336882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.337325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.338105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.338531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.367332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f14278c4-5b90-480c-8a21-cd632d871920 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041340 Jun 24 08:55:38.367870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 762/1411] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:38.715272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:38.716236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:38.722767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.723217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.723984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.725101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.754155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0ad93844-46b0-4988-aa66-54272a3dd1fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042816 Jun 24 08:55:38.754818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 650/1412] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:38.810625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:38.811227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:38.817655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.818776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.819525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.819950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.890150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:38.890707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:38.896840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.897484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.898095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:38.898533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:38.977110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:38.981407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:38.984653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-02f58c56-c022-4ec3-8a3a-a71bfe7f65ba tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098850 Jun 24 08:55:38.985377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 651/1413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:38.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-81fac085-2331-46b8-acef-a17e7a6af786 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.182431 Jun 24 08:55:38.989847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 763/1414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:39.379115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:39.380038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:39.386140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:39.386595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:39.387370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:39.387815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:39.417388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4841e39c-3840-45e8-b218-593196b0bb1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042285 Jun 24 08:55:39.417964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 652/1415] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:39.765983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:39.766902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:39.773516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:39.773980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:39.774736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:39.775426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:39.803129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e8b230d1-5fca-49e4-b2d8-8787700f1fdb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Jun 24 08:55:39.803671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 764/1416] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:40.002172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:40.002766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:40.006166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:40.006809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:40.009625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.010078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.010852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.011287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.012986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.013437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.014221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.014655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.097398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:40.104812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd4fe823-2f3d-49b7-9ae7-e3ed9635e10e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.106549 Jun 24 08:55:40.105371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 653/1417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:39 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:40.167199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:40.174664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2c65c5e-a7ac-46c7-b843-f26b94b2a757 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.172776 Jun 24 08:55:40.175256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 765/1418] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:40.430081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:40.430928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:40.436991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.437435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.438228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.438661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.466675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f0ac2a82-4df6-4bd4-a353-95f69c72c2df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041614 Jun 24 08:55:40.467228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 654/1419] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:40.814867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:40.815819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:40.822593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.823047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.823814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:40.824247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:40.837985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:40.853122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-41937980-9dee-41d7-b4f9-03940326b6b8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042235 Jun 24 08:55:40.853686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 766/1420] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:41.121607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:41.122236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:41.128750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.129195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.129975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.131031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.192405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:41.193209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:41.196966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:41.200042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.200487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.201251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.201694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.205119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e9e7d955-b6d9-4772-bddf-e78b2c14f411 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087117 Jun 24 08:55:41.205699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 655/1421] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:41.331604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:41.339552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eb96c1a1-9cea-429a-9e32-7479f1f31472 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151059 Jun 24 08:55:41.340113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 767/1422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:41.479048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:41.479947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:41.485960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.486405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.487164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.487590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.515888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-14d87858-0539-47f8-9bcd-473977bf1513 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040969 Jun 24 08:55:41.516433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 656/1423] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:41.865041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:41.866009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:41.872095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.872537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.873291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:41.873746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:41.902280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0cdb8523-a2f4-40ed-b888-a35f08c1affd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041743 Jun 24 08:55:41.902834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 768/1424] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:42.222145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:42.222707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:42.229588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.230063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.230821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.231250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.292578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:42.300067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6f63098b-779a-4671-9609-67b782ae68ef tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082060 Jun 24 08:55:42.300626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 657/1425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:42 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:42.356403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:42.357008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:42.363524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.363972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.364730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.365174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.495270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:42.502683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4eac57fa-f49f-4f69-bbf7-e046983356bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150114 Jun 24 08:55:42.503240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 769/1426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:42.528308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:42.529245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:42.535386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.535861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.537251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.537711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.565945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3b2a5f2e-af7e-440e-b8ec-4ff69f0fc781 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041771 Jun 24 08:55:42.566497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 658/1427] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:42.914181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:42.915105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:42.921078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.921526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.922332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:42.922761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:42.951948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-94f92280-63e9-43a9-9f75-022eee8f47e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041794 Jun 24 08:55:42.952504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 770/1428] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:43.316654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:43.317262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:43.324353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.324798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.325564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.326028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.386883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:43.394350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4389a59b-5252-4ca4-b45e-b2e011f2fef0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081562 Jun 24 08:55:43.394909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 659/1429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:43.520095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:43.521616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:43.528098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.528541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.529506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.529959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.578092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:43.578930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:43.585509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.585980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.586747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.587254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.600784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:43.617775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1d565680-c836-4816-9e15-a0016dbd91e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043701 Jun 24 08:55:43.618343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 660/1430] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:43.661575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:43.669222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79e2dbdb-045b-4724-9a28-b5321851eaed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153014 Jun 24 08:55:43.669817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 771/1431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:43.713570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:55:43.713755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 08:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:55:43.964293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:43.965209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:43.971168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.971613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:43.972370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:43.972976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.000706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fa398b38-0bfe-4479-a1ee-87b644fb9304 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040898 Jun 24 08:55:44.001316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 661/1432] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:44.412309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:44.412914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:44.419007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.419456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.420213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.420647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.484407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:44.492558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a6ed3186-b44d-487d-9109-f1938966cac3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084637 Jun 24 08:55:44.493125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 772/1433] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:44.629157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:44.630111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:44.637570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.638254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.639159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.639600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.669565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-962f4745-aef7-438c-a3b9-a8baa35b19aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044575 Jun 24 08:55:44.670062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 662/1434] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:44.685326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:44.685964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:44.692375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.692820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.693575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:44.694030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:44.823610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:44.831271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06866c21-1dd8-4170-8612-bafca89bf7db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149797 Jun 24 08:55:44.831862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 773/1435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:45.012461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:45.013299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:45.019478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.019926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.021344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.021925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.051082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4e50e5c3-762e-4d64-a7e2-6c7df82738da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042701 Jun 24 08:55:45.051632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 663/1436] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:45.509726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:45.510330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:45.516344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.516770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.517525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.517977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.578653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:45.586054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3b442e84-1cf8-4b80-a393-5b9136416fdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080753 Jun 24 08:55:45.586602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 774/1437] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:45.681141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:45.682207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:45.688643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.689096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.689894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.690331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.718277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cc7165f7-8b00-4959-af70-bc7762e029fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041748 Jun 24 08:55:45.719104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 664/1438] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:45.849376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:45.850051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:45.856451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.856897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.857679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:45.858122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:45.998637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:46.006385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2c5d9db5-067e-4dd3-b5f0-8a9d4699806f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161371 Jun 24 08:55:46.006961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 775/1439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:46.062653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:46.063583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:46.069632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.070119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.070881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.071317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.103657 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a15765e2-4137-4f37-a088-4ff4b28762d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Jun 24 08:55:46.104145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 665/1440] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:46.603175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:46.603784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:46.609949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.610401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.611174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.611606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.673098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:46.681212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4aa9926c-da49-4c8c-ae3c-ce3898eab262 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082453 Jun 24 08:55:46.681798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 776/1441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:46 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:46.730668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:46.731660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:46.738549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.739002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.740574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:46.741062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:46.769069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b5e6eb47-95cc-4175-994e-bd42c3626c88 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042601 Jun 24 08:55:46.769610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 666/1442] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:47.023531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:47.024164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:47.031390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.031840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.032606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.033036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.116065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:47.117066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:47.123236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.123765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.124603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.125104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.157127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-33e321aa-4dda-4b2d-a791-5dc325ae6e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Jun 24 08:55:47.157718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 667/1443] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:47.168591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:47.176196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d7a1d00-a99f-4e6e-ba6d-3b5d58856994 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156517 Jun 24 08:55:47.176818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 777/1444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:47.698196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:47.698815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:47.705168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.705616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.706413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.707186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.771620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:47.779578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7cd6ff1-cf0a-475a-8264-6a90c4c108d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085269 Jun 24 08:55:47.780142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 668/1445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:47 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:47.780874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:47.781826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:47.788367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.788814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.789576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:47.790038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:47.818886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3d2f54d-8416-4637-a62a-315adca319b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041889 Jun 24 08:55:47.819431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 778/1446] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:48.104486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:55:48.104708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:55:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:55:48.168669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:48.169536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:48.175562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.176005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.176817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.177247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.194489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:48.195127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:48.201691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.202149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.202921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.203355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.207135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6a5bad85-0f0c-4ba4-ad0f-eb4e5da3549f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Jun 24 08:55:48.211645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 669/1447] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:48.334227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:48.341831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8eff55c0-d048-432d-9ce2-3deb512f486e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151731 Jun 24 08:55:48.342396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 779/1448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:48.797005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:48.797515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:48.804656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.805100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.805890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.806321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.830504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:48.831564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:48.837545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.838025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.838789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:48.839221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:48.866875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:48.869560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5f75a819-1d69-47d1-aa7b-daf37a4bc3a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042948 Jun 24 08:55:48.873478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 780/1449] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:48.874668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bce57010-74b4-4a8f-bcb5-a2a1630aafc7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081556 Jun 24 08:55:48.875414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 670/1450] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:49.219475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:49.220400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:49.227226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.227671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.228434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.228868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.258000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f57f3d4f-413f-48fd-8bbf-11c8ab8e37ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042460 Jun 24 08:55:49.258564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 781/1451] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:49.358733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:49.359372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:49.366137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.366589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.367350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.367786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.498168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:49.505700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d1219afb-b910-4d6e-a6d1-fe8039d6da00 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150797 Jun 24 08:55:49.506258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 671/1452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:49.881625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:49.882600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:49.888967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.889412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.890216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.890658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.891477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:49.892289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:49.899161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.900125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.900896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:49.901328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:49.922988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-35b336d1-6247-4ed7-b8d6-a432aba9314f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046404 Jun 24 08:55:49.923575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 782/1453] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:49.962249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:49.969575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-640c3dbd-29d4-44d4-9b7a-4d7f74ca3910 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082163 Jun 24 08:55:49.970165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 672/1454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:49 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:50.269943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:50.270868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:50.277617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.278098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.278861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.279302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.281798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:50.311083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f1cec1da-0bb4-40b7-a50e-af762b1e3262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Jun 24 08:55:50.311643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 783/1455] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:50.523655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:50.524498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:50.531081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.531527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.532295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.532725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.663536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:50.671140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-27bb1af5-dc20-46fd-9fbd-006eda3d76bc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152060 Jun 24 08:55:50.671700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 673/1456] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:50.935098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:50.935941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:50.942687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.943170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.943934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.944412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.973683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-edb94f63-7b5d-46b8-8ca6-599e9f408e6e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042670 Jun 24 08:55:50.974222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 784/1457] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:50.985983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:50.986590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:50.992592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.993039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:50.993829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:50.994266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.057405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:51.064900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e54e8edb-0d54-4ed7-86dd-d1ab36cf1280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082704 Jun 24 08:55:51.065459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 674/1458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:51.323389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:51.324313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:51.330866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.331316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.332075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.332508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.360033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8196af7f-abb6-4073-b55d-d92151859a95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040581 Jun 24 08:55:51.360578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 785/1459] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:51.693408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:51.694053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:51.700037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.700467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.701230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.701679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.832006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:51.839899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5670a08-b8c3-47ae-a86e-6fccf53673ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155724 Jun 24 08:55:51.840454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 675/1460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:51.985103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:51.985948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:51.987778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:51.993637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.994112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:51.994866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:51.995294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.025079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cb25964-121d-4d3f-999b-72cc60e49406 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043774 Jun 24 08:55:52.025627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 786/1461] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:52.081345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:52.081991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:52.088524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.088963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.089741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.090175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.151816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:52.159255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-632f9c08-dba3-4f4d-b844-f0b69626fb42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081743 Jun 24 08:55:52.159823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 676/1462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:52 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:52.371870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:52.372784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:52.379220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.379659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.380958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.381387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.410751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-676b07f7-ab64-4366-8b8f-4c1521f4f80f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Jun 24 08:55:52.411303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 787/1463] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:52.857150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:52.857797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:52.864822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.865270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.866061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:52.866499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:52.870390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:52.998426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:53.005913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b3257889-8a3e-42d2-a534-1b7dce72f38d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152668 Jun 24 08:55:53.006474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 677/1464] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:53.037237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:53.038228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:53.044271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.044722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.045519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.045980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.074041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-207d2545-a5ae-4703-bd4d-74cbedfac4f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041430 Jun 24 08:55:53.074600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 788/1465] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:53.176434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:53.176962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:53.183031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.183478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.184249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.184687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.245849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:53.253333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1cf39956-9f80-4567-8b0f-b97f1907b6db tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080868 Jun 24 08:55:53.253941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 678/1466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:53.422268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:53.423182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:53.429598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.430016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.430765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:53.431192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:53.460749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47c74f66-9745-4b69-a55c-892de5e4d6cc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042335 Jun 24 08:55:53.461303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 789/1467] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:54.023669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:54.024275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:54.030915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.031457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.032220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.032653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.085709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:54.086626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:54.092698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.093602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.093905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.094335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.123814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0918bcc1-692f-42d3-b938-e38bdebb1e78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042090 Jun 24 08:55:54.124381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 790/1468] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:55:54.162380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:54.170059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e7e68c1-350f-4efe-aafd-89b723d8f16e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150914 Jun 24 08:55:54.170623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 679/1469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:54.271930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:54.272536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:54.282898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.283287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.284055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.284492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.350326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:54.357880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3ca4ac9-06e7-4fdb-b1e8-a55f3f89ccde tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.090357 Jun 24 08:55:54.358452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 791/1470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:54.472381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:54.473305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:54.479933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.480382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.481147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:54.481579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:54.509472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-005d0a27-afda-4f64-a72e-57f6b670c6c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041046 Jun 24 08:55:54.510057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 680/1471] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:55.136294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:55.137208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:55.143676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.144119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.144877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.145306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.174055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6ecbc315-195b-4200-b032-a7d70f7d2129 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041730 Jun 24 08:55:55.174599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 792/1472] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:55.187487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:55.188132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:55.190469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:55.196393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.196840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.197607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.198065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.327033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:55.334535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b59de3f5-dc36-48c6-a5db-2a71bdf7c2bf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150951 Jun 24 08:55:55.335092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 681/1473] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:55.374448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:55.375221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:55.381960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.382402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.383149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.383577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.443730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:55.451174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f1cb9be-65f8-463b-ab1f-f12c2b7ed19d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080514 Jun 24 08:55:55.451733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 793/1474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:55 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:55.520109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:55.521067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:55.527304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.527745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.528581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:55.529010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:55.558104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bb3a0644-a7bc-49e2-820f-6db0a1982822 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041867 Jun 24 08:55:55.558708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 682/1475] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:56.186655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:56.187512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:56.194568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.195011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.195766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.196192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.225263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b9c2f512-d996-4adb-b5d0-370671cf06e9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042731 Jun 24 08:55:56.225829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 794/1476] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:56.352038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:56.352637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:56.359096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.359541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.360296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.360726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.468465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:56.468982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:56.475085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.475538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.476306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.476741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.491611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:56.499378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eaef59d6-d90a-4b47-9da6-8d6bf6deecde tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151210 Jun 24 08:55:56.499949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 683/1477] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:56.537647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:56.545233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-daad122c-4a75-4b82-a866-30e77da721f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080814 Jun 24 08:55:56.545812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 795/1478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:56 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:56.570656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:56.571580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:56.577496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.577971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.578723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:56.579151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:56.606539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d9dbf13e-ac29-446f-8e6b-7e9710792eda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040453 Jun 24 08:55:56.607097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 684/1479] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:57.237038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:57.237973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:57.245027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.245475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.246273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.246697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.275581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cc779d49-a502-45cf-a23e-0f17ad4ad635 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042525 Jun 24 08:55:57.276121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 796/1480] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:57.516328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:57.516942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:57.523996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.524704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.525479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.525955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.562448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:57.563061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:57.569218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.569689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.570490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.570957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.640308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:57.648389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-91853208-3fa9-40c6-8d69-f63b36b34e67 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.089681 Jun 24 08:55:57.648953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 797/1481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:57 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:55:57.653796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:57.654711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:57.660570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.661194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.661986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:57.662426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:57.678085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:57.685780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-33b6e129-d33b-49a9-9b55-734cce15272b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.173368 Jun 24 08:55:57.686419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 685/1482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:57.691493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-751c671f-ce41-4208-83b7-65c41867b5c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 Jun 24 08:55:57.692553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 798/1483] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:58.287419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:58.288365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:58.294422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.294870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.295630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.296065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.325800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b2b9627e-5efd-4ab8-9d42-271498130c3e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042321 Jun 24 08:55:58.326358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 686/1484] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:58.664979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:58.665597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:58.672190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.672635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.673400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.673855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.703411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:58.704159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:58.710890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.711347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.712131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.712576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.741239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:58.743487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:55:58.750563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1ac0db7b-04c3-4031-a600-7cad13662e73 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.089959 Jun 24 08:55:58.751146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 799/1485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:58.756068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:58.756912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:58.765707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.766238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.767075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:58.767573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:58.798974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ab922670-8023-4a14-af42-fff136333f67 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Jun 24 08:55:58.799549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 800/1486] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:55:58.851099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:58.859026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b6757a17-5721-4e85-b8c9-a08b3313a71b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159437 Jun 24 08:55:58.859633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 687/1487] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:59.338594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:59.339519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:59.345911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.346358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.347131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.347565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.380007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-23e818c9-7af5-4c0a-9e54-5e2ce1b85fd6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044973 Jun 24 08:55:59.380594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 801/1488] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:55:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:55:59.772241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:59.772878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:59.779640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.780087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.780849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.781285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.810050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:59.810982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:59.817734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.818192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.818961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.819397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.842301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:55:59.848359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8e7fb074-1624-495e-ac5f-b75aab8ed762 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042740 Jun 24 08:55:59.849115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 802/1489] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:55:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:55:59.850045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-857e8136-a859-4cd8-942a-c9f3555a8bbf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081623 Jun 24 08:55:59.850619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 688/1490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:59 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:55:59.875910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:55:59.876473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:55:59.882994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.883440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:55:59.884200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:55:59.884631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.019626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:00.027654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-39fb9c13-2558-4193-aea5-5ccb5c0feb25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155462 Jun 24 08:56:00.028228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 803/1491] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:55:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:00.391914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:00.392837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:00.399871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.400320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.401083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.401516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.430533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9bfc7c24-f947-4aad-bd63-53e0f882d309 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042602 Jun 24 08:56:00.431091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 689/1492] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:00.860187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:00.861043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:00.866434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:00.867117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:00.867644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.868098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.868872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.869307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.873556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.874035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.874797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:00.875227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:00.899218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60172642-856d-4f3a-8d03-661cd41a81d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043104 Jun 24 08:56:00.900052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 804/1493] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:00.936976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:00.944960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4bf9d70c-4c65-483e-b4d5-258b9b36f5ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082419 Jun 24 08:56:00.945518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 690/1494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:01.045511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:01.046141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:01.052243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.052687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.053440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.053894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.181480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:01.189565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bde846ac-b1f8-4bed-9fd9-976977cdfa09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147883 Jun 24 08:56:01.190167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 805/1495] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:01.442875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:01.443708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:01.449830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.450281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.451044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.451478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.480051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-989d1260-9de8-4e73-966a-3f5a49411a76 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041699 Jun 24 08:56:01.480596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 691/1496] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:01.911142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:01.912068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:01.918626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.919071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.919827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.920260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.950227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-51686588-f8b9-4719-b721-6761b01ba35a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042919 Jun 24 08:56:01.950790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 806/1497] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:01.962099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:01.962695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:01.969167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.969621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:01.970444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:01.970880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.036051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:02.043878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-38ab9729-f50a-4516-aee5-f506d61bbd45 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085806 Jun 24 08:56:02.044351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 692/1498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:02.206836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:02.207404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:02.213462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.213936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.214697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.215128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.341553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:02.349487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-80c25845-e213-41e8-8133-af764c20edf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.146576 Jun 24 08:56:02.350079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 807/1499] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:02.491975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:02.492817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:02.498786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.499236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.500001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.500436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.527357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:02.532638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ac9596e5-c8e2-48fa-bdf0-3339618602d7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044785 Jun 24 08:56:02.533207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 693/1500] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:02.962887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:02.963810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:02.970413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.970856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:02.971609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:02.972036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.001009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e8b9968-0fa1-4610-8375-553d435a5145 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042080 Jun 24 08:56:03.001545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 808/1501] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:03.061016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:03.061617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:03.068142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.068601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.069365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.069833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.129806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:03.137195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7daab190-f695-4d8b-a7b0-8b8615d5c8e8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080066 Jun 24 08:56:03.137774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 694/1502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:03 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:03.366743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:03.367433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:03.373497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.373981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.374736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.375195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.511008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:03.518457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d510d5d1-cf12-4ed5-83f3-08b8cd7013f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155596 Jun 24 08:56:03.519024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 809/1503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:03.544507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:03.545425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:03.551926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.552417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.553183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:03.553701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:03.584255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e886924b-58e9-41ca-94a9-8e8427d79261 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Jun 24 08:56:03.584821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 695/1504] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:04.016434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:04.017366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:04.025046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.025497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.026298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.026733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.055969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e201b733-7e08-449f-8e1e-ca06034110a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Jun 24 08:56:04.056518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 810/1505] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:04.154384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:04.154986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:04.161668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.162149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.162919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.163347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.224502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:04.231897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-21d0e6e9-2e4e-4406-bfb8-b7b16e42d2de tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081376 Jun 24 08:56:04.232452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 696/1506] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:04 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:04.536673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:04.537366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:04.543358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.543796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.544555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.544979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.596710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:04.598396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:04.604424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.604874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.605812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:04.606254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:04.638451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-41faf9f8-256c-4db8-9323-d9770cceca0a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045632 Jun 24 08:56:04.642421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 697/1507] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:04.675287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:04.683508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1abb720-af99-402b-ab18-d1a1716afca2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151299 Jun 24 08:56:04.684063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 811/1508] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:05.067704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:05.068770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:05.074795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.075229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.075992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.076427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.105165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-95a12fdf-1b99-4715-bb9f-6f4c27023258 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Jun 24 08:56:05.105738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 698/1509] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:05.249209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:05.249815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:05.256780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.257218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.258006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.258436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.326379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:05.334509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b32e131-bf05-4111-a5d0-87e13f815857 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.089216 Jun 24 08:56:05.335073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 812/1510] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:05.650717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:05.651643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:05.658111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.658564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.659331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.659765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.691052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1e6a861e-2425-43af-ac1e-11cd215db235 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Jun 24 08:56:05.692272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 699/1511] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:05.700181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:05.700813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:05.707633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.708073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.708828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:05.709249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:05.837950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:05.845421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7ce96c44-76f6-410c-9751-b3c40f828c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149114 Jun 24 08:56:05.846022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 813/1512] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:06.116747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:06.117681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:06.123629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.124081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.124833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.125272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.152747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b6a30d77-1ce7-4e40-9cd4-6dc933d609c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040536 Jun 24 08:56:06.153286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 700/1513] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:06.351955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:06.352590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:06.359042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.359488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.360248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.360682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.422798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:06.430512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fd55f51e-00fb-45a1-b308-5934d6cf6863 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083049 Jun 24 08:56:06.431140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 814/1514] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:06.703514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:06.704393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:06.711521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.711966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.712725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.713157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.742086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b453f63e-2549-455d-bf56-6a296c2949cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042447 Jun 24 08:56:06.742637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 701/1515] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:06.861993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:06.862591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:06.868544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.868983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:06.869762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:06.870211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.002047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:07.010266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-177fd907-c5f5-48ef-96c0-85a7428c0e2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152175 Jun 24 08:56:07.010833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 815/1516] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:07.164378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:07.165313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:07.171502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.171941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.172733 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.173190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.202525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-94741e40-88f3-42ea-a4db-c03e50b9d28c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042108 Jun 24 08:56:07.203079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 702/1517] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:07.448681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:07.449292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:07.455764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.456205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.456958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.457463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.471956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:07.518209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:07.526044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ae7ac483-7d5b-4f73-b90e-c34cbb63f77b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081216 Jun 24 08:56:07.526598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 816/1518] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:07.754155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:07.754991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:07.761393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.761861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.762635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:07.763064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:07.793535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-186d03e1-1bda-4113-be1e-447881839e4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043578 Jun 24 08:56:07.794183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 703/1519] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:08.028395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:08.029711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:08.036790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.037231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.038019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.038450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.170814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:08.178318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b0f702d5-e20f-4cb3-a15b-405c1e9a9c5f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154123 Jun 24 08:56:08.178870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 817/1520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:08.214052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:08.214978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:08.221545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.222011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.222801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.223232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.250721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bf6c9906-d558-4cb1-8d52-d8a06fa84ce5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040925 Jun 24 08:56:08.251258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 704/1521] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:08.543384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:08.543985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:08.550447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.551107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.551864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.552294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.616871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:08.624450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3f0728f2-11d8-4866-aa69-a06da5e03c12 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084968 Jun 24 08:56:08.625007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 818/1522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:08 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:08.805219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:08.806127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:08.812645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.813093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.813907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:08.814344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:08.843461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb970935-e46c-4f04-8683-c5a9a6b0ea0d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042838 Jun 24 08:56:08.844011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 705/1523] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:09.195993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:09.196526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:09.202712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.203160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.203933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.204367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.262802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:09.263743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:09.270291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.270742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.271509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.271944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.301504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8d7471be-a0f3-448f-820a-ff0266af413d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042623 Jun 24 08:56:09.302107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 706/1524] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:09.333728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:09.341548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-957eb659-b459-46c9-a67f-dc16e7b87552 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149660 Jun 24 08:56:09.342145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 819/1525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:09.640233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:09.640836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:09.647590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.648034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.648788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.649476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.709231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:09.718302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2a9ff4f9-0e78-4cb9-a14a-cc612d435adc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081804 Jun 24 08:56:09.718878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 707/1526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:09 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:09.855952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:09.856873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:09.863524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.863963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.864719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:09.865147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:09.893990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ce9c652b-a097-4518-b27b-a5c62c68dba5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042242 Jun 24 08:56:09.895195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 820/1527] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:10.313048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:10.314054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:10.321144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.321596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.322392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.322828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.350971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1936568d-469b-43e8-a3d0-0b14643e935a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 Jun 24 08:56:10.351526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 708/1528] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:10.360517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:10.361128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:10.367598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.368072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.368838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.369272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.500592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:10.508306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dede8f50-daa2-40b4-ba29-40c2dfffd944 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151664 Jun 24 08:56:10.508869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 821/1529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:10.735373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:10.735982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:10.742621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.743075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.743838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.744275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.804875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:10.812365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cf014477-c8e1-4d42-9dcd-fc531c868505 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080895 Jun 24 08:56:10.812922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 709/1530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:10.906358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:10.907230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:10.913823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.914274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.915030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:10.915497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:10.945782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ecdededf-16e7-4967-bb5d-5db2214260a7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043360 Jun 24 08:56:10.946360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 822/1531] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:11.361968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:11.362900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:11.370147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.370602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.371372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.371808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.385333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:11.400550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3b1407cc-1d5d-421c-a051-9ac7d8d835d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042592 Jun 24 08:56:11.401111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 710/1532] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:11.526371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:11.526970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:11.533020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.533516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.534245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.534673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.665470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:11.673256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-370d07b1-a4f7-4d56-8a5b-685521a7e84f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151010 Jun 24 08:56:11.673855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 823/1533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:11.829011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:11.829535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:11.836116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.836564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.837323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.837796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.901328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:11.908879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6776e9ab-1c93-4083-984f-9b4ee7b7acd0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083878 Jun 24 08:56:11.909440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 711/1534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:11.956371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:11.957885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:11.964358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.964802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.965557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:11.966015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:11.993973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a885a0d7-7419-412e-8aec-c39480374a3b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041513 Jun 24 08:56:11.994518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 824/1535] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:12.412457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:12.413392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:12.420617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.421408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.422770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.423434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.457275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5aa67359-3974-419a-b189-082e65424bb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048797 Jun 24 08:56:12.457874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 712/1536] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:12.691372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:12.691883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:12.698211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.698666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.699440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.699879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.836577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:12.845089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ede81d93-d4e2-460b-8e4b-0144a28df064 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157690 Jun 24 08:56:12.845681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 825/1537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:12.926464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:12.927075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:12.933956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.934404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.935173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:12.935603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:12.999982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:13.005746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:13.006677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:13.008569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-36275b97-60e3-410f-bc35-bba753c5a730 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086767 Jun 24 08:56:13.009158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 713/1538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:13.013008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.013461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:13.014292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.014758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:13.049903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9d9ad9c2-23b6-4443-a44b-c37e37dc5697 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048125 Jun 24 08:56:13.050534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 826/1539] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:13.468854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:13.469809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:13.476361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.476801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:13.477565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.478029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:13.508632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e7965c7a-1b46-4585-8ee8-e6dba82ae2f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Jun 24 08:56:13.509199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 714/1540] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:13.866265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:13.866872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:13.872881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.873401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:13.874111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:13.874542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.005264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:14.012838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b863b5e-4e44-484e-ab74-d69dde1d7dc7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150972 Jun 24 08:56:14.013430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 827/1541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:14.025799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:14.026411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:14.032510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.032959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.033789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.034226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.061631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:14.062575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:14.069849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.070325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.071075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.071509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.097119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:14.100999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7cb81c08-fc8d-494c-be3e-c05a881ffb4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043198 Jun 24 08:56:14.101564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 828/1542] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:14.104792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-80e5aa01-76fb-46f0-a998-9b200ca27ff3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083191 Jun 24 08:56:14.105350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 715/1543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:14.520605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:14.521540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:14.527887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.528344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.529112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:14.529551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:14.559411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d504e1f-d842-4471-a2a7-05628bc8906b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Jun 24 08:56:14.559973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 829/1544] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:15.030939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:15.031557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:15.038681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.039128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.039899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.040337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.113750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:15.114707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:15.121337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.121832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.122597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.123029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.153078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4dc1f4bd-e6bc-4d14-ac94-09d96628676b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043912 Jun 24 08:56:15.153564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 830/1545] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:15.158039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:15.158648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:15.167202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.167636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.168396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.168824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.169813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:15.178035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6e0c886a-79de-40a8-9b57-864afa5cc941 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151507 Jun 24 08:56:15.178601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 716/1546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:15.230169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:15.237636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6f57caa3-2773-4c4b-8961-d986dfa528e2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083118 Jun 24 08:56:15.238867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 831/1547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:15 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:15.571154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:15.572081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:15.578104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.578561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.579324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:15.579761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:15.608769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-86dbf412-0ed8-4fd6-a541-f397dae8b891 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Jun 24 08:56:15.609331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 717/1548] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:16.164844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:16.165711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:16.172257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.172699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.173452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.173910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.196003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:16.196609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:16.203141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.203589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.204362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.204797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.204908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d1b0cc89-27f2-4ac3-8e1f-3d9948449157 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044107 Jun 24 08:56:16.205412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 832/1549] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:16.255511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:16.256289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:16.262311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.262756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.263507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.263935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.266511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:16.339854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:16.347326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b074efec-2cd0-4100-b1eb-552cb0beb532 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.096288 Jun 24 08:56:16.347895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 833/1550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:16 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:16.368520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:16.376016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9b57ce17-96fb-4262-8514-9224e6ea329e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.184003 Jun 24 08:56:16.376577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 718/1551] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:16.620171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:16.621089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:16.627200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.627642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.628427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:16.628860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:16.658735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5fd57701-5d45-42b1-be50-3f648e7b201b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jun 24 08:56:16.659289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 834/1552] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:17.217193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:17.218166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:17.225155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.225609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.226416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.226838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.255357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-520fe2ba-ed28-4bcc-9dc3-fe557ac04ea9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 Jun 24 08:56:17.255897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 719/1553] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:17.364712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:17.365316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:17.371779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.372221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.372968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.373398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.393580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:17.394221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:17.400388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.400833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.401599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.402055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.434154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:17.441746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1a26828-d2c7-463f-928c-a2dc50d74b8b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081480 Jun 24 08:56:17.442324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 835/1554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:17.532930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:17.541107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b008ac54-2d08-4ec0-91f8-cbdda4341add tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151321 Jun 24 08:56:17.541683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 720/1555] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:17.670854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:17.671775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:17.673645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:17.679090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.679559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.680318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:17.680784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:17.709924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b252a6b-16a3-4342-822b-0f9ca3667069 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Jun 24 08:56:17.710544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 836/1556] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:18.267030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.267947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:18.275364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.275823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.276584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.277014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.305861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4279ee4a-29d3-486d-a680-881fd2bb85c3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042755 Jun 24 08:56:18.306408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 721/1557] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:18.458520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.459125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:18.465631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.466102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.466862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.467295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.528030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:18.535572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c48122fb-fd92-403e-a248-6c0873ed1fc9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080931 Jun 24 08:56:18.536129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 837/1558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:18.557484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.558135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:18.564117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.564568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.565336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.566411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.693731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:18.701292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-87d835eb-a5fe-4f61-8b34-a8cfa801afb5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147667 Jun 24 08:56:18.701894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 722/1559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:18.721257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:18.722772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:18.728879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.729344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.730120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:18.730552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:18.758901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ffcd293-72af-4705-9493-3ed640a31742 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041560 Jun 24 08:56:18.759450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 838/1560] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:19.317567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:19.318662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:19.324896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.325347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.326578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.356170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8cfc9136-018d-4f3d-9cde-be55c78e2b23 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042566 Jun 24 08:56:19.356716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 723/1561] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:19.552990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:19.553616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:19.560079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.560520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.561266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.561719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.624782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:19.633617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e9c4537f-6dd1-4b75-a3c1-3907aa4467cf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085077 Jun 24 08:56:19.634217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 839/1562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:19 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:19.718385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:19.718994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:19.725399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.725881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.726671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.727102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.771327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:19.772294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:19.778672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.779122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.779894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:19.780329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:19.810179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46371c12-8455-4c96-8cf8-451c60beac95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Jun 24 08:56:19.810754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 840/1563] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:19.858410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:19.866494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1cf4b198-b6df-40d1-a4a1-7f6ea935dea9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151912 Jun 24 08:56:19.866998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 724/1564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:20.368501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:20.369428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:20.377172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.377615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.378412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.378840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.407853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-314bb6ba-7f92-4494-a74d-2f915ea3bbf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043430 Jun 24 08:56:20.408409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 841/1565] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:20.651342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:20.651885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:20.658432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.658881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.659648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.660731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.721950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:20.730446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fe09c155-37be-41df-8767-d246e1832f4e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083313 Jun 24 08:56:20.731015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 725/1566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:20.821718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:20.822643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:20.829248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.829728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.830504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.830939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.860618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9199e90-f7bf-4e22-b605-ece6de4fa82e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Jun 24 08:56:20.861177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 842/1567] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:20.883448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:20.884059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:20.890027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.890458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:20.891213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:20.891641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.024714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:21.032893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8970550a-f1de-4fa0-9685-f8703aa7278c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154095 Jun 24 08:56:21.033452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 726/1568] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:21.420058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:21.420966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:21.427464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.427924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.428664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.429097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.458219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7ff8167-c94c-48be-b87b-cb3cc7be4351 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042036 Jun 24 08:56:21.458777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 843/1569] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:21.747387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:21.747959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:21.754638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.755106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.755877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.756344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.759012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:21.818816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:21.826495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1cbaef78-2cc6-4b5a-a944-2a006a946d2a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083060 Jun 24 08:56:21.827067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 727/1570] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:21.872522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:21.873476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:21.880054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.880501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.881259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:21.881713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:21.910157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e4880dec-6788-4587-8652-0082b4f4c19d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041099 Jun 24 08:56:21.910725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 844/1571] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:22.049253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:22.049917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:22.056104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.056556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.057328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.057825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.188180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:22.195760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e1a66bdc-de2b-451f-a7ab-a30f7f878fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150400 Jun 24 08:56:22.196314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 728/1572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:22.470007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:22.470842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:22.476919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.477369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.478148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.478583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.507084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-564ec054-cd27-4548-be71-47e1cf2e93e6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041159 Jun 24 08:56:22.507635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 845/1573] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:22.843437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:22.844072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:22.850583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.850990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.851750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.852191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.915997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:22.921809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:22.922731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:22.923618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d6e1ca33-75d7-47e6-9df0-325f5cc3d7c7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084105 Jun 24 08:56:22.924265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 729/1574] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:22 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:22.929617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.930090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.930844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:22.931275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:22.960763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b0ba554a-e5d5-4f29-85b4-26c85bb46e1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Jun 24 08:56:22.961309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 846/1575] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:23.214478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:23.214982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:23.221104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.221547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.222331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.222764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.349257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:23.357064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-76464ed7-e3a3-4e1a-929e-f8a5195faf41 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147111 Jun 24 08:56:23.357630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 730/1576] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:23.520119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:23.521049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:23.527659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.528106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.528901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.529335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.558533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1407d74-5f9c-4309-ace0-e5bcae1e5088 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043704 Jun 24 08:56:23.559087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 847/1577] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:23.940837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:23.941404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:23.943779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:23.949138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.949579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.950370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.950801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.975771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:23.977239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:23.988305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.989044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:23.990036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:23.990525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:24.020411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bb8ff1cd-13a3-4043-8f2e-23fdf77d756d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051889 Jun 24 08:56:24.020759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:24.020986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 848/1578] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:24.028786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-af5a3263-2fd1-4e74-90fc-fe6c43c766c4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091837 Jun 24 08:56:24.029352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 731/1579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:23 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:24.375095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:24.375703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:24.381617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:24.382095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:24.382857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:24.383287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:24.518683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:24.521458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:24.528365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-08d17bac-0a68-4b2f-9513-d019cb8f485e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157243 Jun 24 08:56:24.528928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 849/1580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:24.570192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:24.571114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:24.577124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:24.577566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:24.578351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:24.578906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:24.607894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8dc804b4-6397-4a23-8eae-4775a06dab7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041627 Jun 24 08:56:24.608451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 732/1581] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:25.032558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:25.033486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:25.040099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.040541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.041296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.041775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.046258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:25.047004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:25.053881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.054330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.055097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.055531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.072275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3129724a-9efb-4112-ba8f-22ea67569690 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Jun 24 08:56:25.072841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 850/1582] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:25.118156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:25.125497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dab85dfa-3427-4591-b847-338ebe9b0e1c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083040 Jun 24 08:56:25.126084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 733/1583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:25.546124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:25.546729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:25.553415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.553887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.554640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.555065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.620130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:25.621051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:25.627187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.627638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.628410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:25.628841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:25.658116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7e79dce-bcc1-46ff-9e8c-b22d0bb387eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041933 Jun 24 08:56:25.658682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 734/1584] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:25.685056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:25.692712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3d80ad2b-cddf-4423-8047-709c4d512509 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150433 Jun 24 08:56:25.693296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 851/1585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:26.084016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:26.084946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:26.091389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.091875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.092672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.093106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.124453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4e358aff-3f26-4fda-a5d4-0fe0043b8433 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Jun 24 08:56:26.124926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 735/1586] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:26.142914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:26.143517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:26.150844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.151284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.152034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.152461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.219423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:26.227191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b5e08ad-a987-4fa3-87c3-2e2e003e7203 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088497 Jun 24 08:56:26.227753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 852/1587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:26.670759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:26.671678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:26.678323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.678773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.679734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.680169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.709349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3997a0f4-17b2-431a-ab41-28aabf4c5875 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042534 Jun 24 08:56:26.710138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:26.710294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 736/1588] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:26.710483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:26.716483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.716926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.717702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:26.718133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:26.849051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:26.856673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aaf53912-0818-4858-b74d-ca3a0afaedbb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150741 Jun 24 08:56:26.857234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 853/1589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:27.136516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:27.137385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:27.143857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.144307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.145068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.145502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.174595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-383d1501-2f7a-4bc2-902b-86ec1303dbad tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Jun 24 08:56:27.175149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 737/1590] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:27.244274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:27.244885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:27.251650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.252287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.253050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.253478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.314277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:27.321765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-76596755-a29f-4451-a4f6-e750eca469ad tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081611 Jun 24 08:56:27.322330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 854/1591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:27.720637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:27.721595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:27.727629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.728079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.728838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.729274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.757972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b40e5f8-7e4f-4c4f-b5c0-dd2cd2a50a5d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041362 Jun 24 08:56:27.758542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 738/1592] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:27.875104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:27.875630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:27.882628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.883075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:27.883846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:27.884274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.016772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:28.024835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5b725049-66e2-441a-b2b1-0438dd260b39 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154154 Jun 24 08:56:28.025419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 855/1593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:28.187081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:28.187923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:28.195081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.195529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.196291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.196765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.226368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ef3e00ca-1ed5-4dd5-aea6-10bea10bfa78 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jun 24 08:56:28.226929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 739/1594] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:28.338113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:28.338729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:28.345195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.345645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.346447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.346882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.408379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:28.416400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f7bef98-3d9d-4ec3-993f-2ef05c5267f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082174 Jun 24 08:56:28.416955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 856/1595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:28 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:28.769843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:28.771325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:28.777757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.778206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.778972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:28.779406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:28.808319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-26ade168-428d-4cb8-b05a-cbe1a553b98a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Jun 24 08:56:28.808822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 740/1596] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:29.042538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:29.043141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:29.049273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.049766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.050530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.050963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.179469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:29.187289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-08df4bd0-576d-48fd-9c07-b409e635e55b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148615 Jun 24 08:56:29.187868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 857/1597] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:29.238702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:29.239647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:29.246195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.246644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.247411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.247879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.276824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7e056b2-e040-4027-828b-c5d4a9bafdf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042049 Jun 24 08:56:29.277372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 741/1598] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:29.433148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:29.433746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:29.440066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.440506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.441274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.441704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.506775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:29.514258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9646cb29-213f-4a33-8649-927e4ed408fe tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085254 Jun 24 08:56:29.514819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 858/1599] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:29 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:29.820694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:29.821609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:29.827692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.828125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.828888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:29.829319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:29.857888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d9b2b294-68bd-4efa-bd06-e8bebc3af6fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041818 Jun 24 08:56:29.858435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 742/1600] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:30.204427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:30.205059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:30.211679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.212120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.212870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.213297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.341603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:30.349972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e239a317-535b-4e75-b28e-fd6bb1d3322c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149347 Jun 24 08:56:30.350537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 859/1601] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:30.384163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:30.385139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:30.391169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.391613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.392370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.392802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.417648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:30.422818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c6540a41-f128-4590-94d8-aecf6e58ea8d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138295 Jun 24 08:56:30.423379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 743/1602] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:30.530987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:30.531618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:30.538740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.539184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.539938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.540369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.602095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:30.609934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a7d8d60e-ec40-467c-8636-8c01df22367d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082675 Jun 24 08:56:30.610344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 860/1603] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:30.870058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:30.870979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:30.876970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.877416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.878214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:30.878652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:30.908421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bc744462-66eb-47e8-934c-791e69aab076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042710 Jun 24 08:56:30.908978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 744/1604] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:31.368473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:31.369070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:31.375108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.375551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.376317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.376724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.434572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:31.435533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:31.442080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.442534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.443306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.443739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.474265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6da365ab-e684-4a0e-8f14-b055d4c847df tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jun 24 08:56:31.475046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 745/1605] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:31.522146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:31.529924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-583ba688-1821-4f79-b17e-1ba4c2e127ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.165878 Jun 24 08:56:31.530494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 861/1606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:31.626230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:31.626804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:31.632828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.633275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.634080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.634516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.696107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:31.703629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d76f7d11-98d8-4c5c-802e-261dbd5a4314 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081320 Jun 24 08:56:31.704180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 746/1607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:31.920351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:31.921179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:31.927758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.928201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.928955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:31.929381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:31.959530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1da7c3bd-4f07-4aac-b9f6-46c83959c70d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043161 Jun 24 08:56:31.960105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 862/1608] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:32.486093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:32.487017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:32.494169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.494618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.495375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.495812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.524480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dca57e6f-29a9-4c5f-be9d-b3c2f601b02f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Jun 24 08:56:32.525025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 747/1609] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:32.547261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:32.547869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:32.554877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.555328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.556091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.556526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.685083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:32.693125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c006b3fb-a591-4981-b4a2-146227f44268 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149682 Jun 24 08:56:32.693761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 863/1610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:32.720236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:32.720845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:32.726896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.727346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.728108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.728545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.791363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:32.798902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3beb4788-014a-4634-a9a4-6ef7ef3e2950 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082488 Jun 24 08:56:32.799468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 748/1611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:32.971337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:32.972262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:32.980584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.981035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:32.981822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:32.982253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.011314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f570c7df-7890-4a67-9c6e-f29de56cff12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Jun 24 08:56:33.011863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 864/1612] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:33.537050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:33.538020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:33.544607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.545062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.545869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.546404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.574408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-95130732-ee4c-4249-88e7-2e0d5de3596e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041994 Jun 24 08:56:33.574966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 749/1613] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:33.710036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:33.710674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:33.716907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.717350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.718158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.718588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.816245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:33.816903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:33.822858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.823303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.824156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:33.824495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:33.847876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:33.856123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef4a7e5b-262d-4dd7-9598-cc1b2dde370b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149889 Jun 24 08:56:33.856704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 865/1614] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:33.886180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:33.893544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-45719c7b-5b7e-4fe4-b0bc-b9f71e11b4b1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081190 Jun 24 08:56:33.894133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 750/1615] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:34.023002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:34.024203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:34.030820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.031262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.032065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.032498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.047037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:34.061999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2330c533-bf52-48dc-9bcd-6ada429044d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043569 Jun 24 08:56:34.062556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 866/1616] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:34.586086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:34.587018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:34.593491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.593969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.594731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.595160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.623572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-74b52b8d-b56d-4166-8eb2-cd795acd1697 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042033 Jun 24 08:56:34.624124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 751/1617] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:34.876791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:34.877340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:34.885639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.886381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.887220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.887652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.910461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:34.911375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:34.917483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.918028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:34.918795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:34.919229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:35.001321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:35.010702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-733b4b8a-c36b-4dd1-b8be-79a3bbdfbe42 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.104007 Jun 24 08:56:35.011540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 752/1618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:35.044897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:35.053773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d658d79d-e5be-4274-bbac-94b50e162fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.183450 Jun 24 08:56:35.054371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 867/1619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:35.074458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:35.075411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:35.082060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:35.082662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:35.083452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:35.083887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:35.117239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5f100c9c-5dc7-48e9-80e5-63d77a4bf786 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046897 Jun 24 08:56:35.117848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 753/1620] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:35.635173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:35.636089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:35.642228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:35.642671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:35.643422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:35.643852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:35.672873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e77eba48-a26e-470f-9ba3-9a5678095b10 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041657 Jun 24 08:56:35.673416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 868/1621] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:36.028053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:36.028662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:36.035962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.036405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.037170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.037601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.070474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:36.071083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:36.077558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.078037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.078806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.079234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.099463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:36.109120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0aa2e43-5f5c-4f09-8906-1e191eff8cc4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084746 Jun 24 08:56:36.110044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 754/1622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:36.128478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:36.129402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:36.135371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.135823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.136587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.137028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.166569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fa299493-416d-44fa-9e0c-0b0b9a89d3f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042027 Jun 24 08:56:36.167331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 755/1623] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:36.219588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:36.227648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-54c56e9b-e444-4164-a127-96086a8cd6e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160979 Jun 24 08:56:36.228207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 869/1624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:36.684722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:36.685645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:36.692243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.692691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.694005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:36.694440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:36.723852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6ecbe8c8-633e-4663-ab3e-ef2777f493da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jun 24 08:56:36.724415 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 756/1625] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:37.126636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:37.127232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:37.134503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.134961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.135744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.136178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.179921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:37.180919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:37.187837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.188410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.189214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.189633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.199756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:37.207572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4c62ffc1-2abc-4cde-a80d-d5cbdd353711 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084825 Jun 24 08:56:37.208272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 870/1626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:37.221990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d8ab8f76-d478-432f-b03b-9eb9d0aa635c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047338 Jun 24 08:56:37.222765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 757/1627] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:37.245145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:37.245913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:37.252133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.252576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.253348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.253938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.391180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:37.398934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b7b2475-de86-4b94-b6be-cc2d790cbfee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157668 Jun 24 08:56:37.399505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 871/1628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:37.735487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:37.736477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:37.742655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.743098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.743855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:37.744346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:37.772432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96f4d675-9abd-4fb9-9490-a40232dda649 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040959 Jun 24 08:56:37.772981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 758/1629] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:38.224814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:38.225409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:38.231975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.232418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.232991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:38.233411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.233586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.233940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:38.240974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.241415 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.242202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.242631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.273716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d52dcc4f-32a8-4b60-8af4-d7a3403e189d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Jun 24 08:56:38.274359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 759/1630] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:38.299471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:38.307747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e284db13-85fb-46ed-a0ba-20cefea753df tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087281 Jun 24 08:56:38.308310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 872/1631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:38.416461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:38.417070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:38.423215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.423664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.424432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.424860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.440824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:38.565382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:38.574861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3d2cdda4-fc2f-4303-8c3c-34f0c32fd3e8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.162150 Jun 24 08:56:38.575556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 760/1632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:38.784470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:38.785451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:38.791560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.791996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.792753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:38.793182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:38.823999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba56d93b-1c98-4a6b-bf7a-d654a622b4a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Jun 24 08:56:38.824563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 873/1633] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:39.285123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:39.286091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:39.293205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.293676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.294461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.294902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.323523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-64c4054d-d91e-4f68-8e06-bb4cf7f8ba09 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042413 Jun 24 08:56:39.324092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 761/1634] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:39.324291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:39.324968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:39.331563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.332005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.332764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.333189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.392602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:39.400653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06107e73-9b43-45c1-a231-87e635d0dbd7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080230 Jun 24 08:56:39.401211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 874/1635] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:39 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:39.592592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:39.593113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:39.599124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.599572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.600389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.600819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.734412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:39.742252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2841743f-9046-4420-9562-f27c6c8a4340 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153584 Jun 24 08:56:39.742828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 762/1636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:39.836266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:39.837177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:39.843745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.844124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.848370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:39.848370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:39.878915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b2259955-d3e6-48d8-a6ed-e33d233c44f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Jun 24 08:56:39.879493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 875/1637] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:40.335349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:40.336274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:40.342784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.343234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.344002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.344444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.374637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aa1c7938-20d8-41d3-91fc-e36a3ed5cde6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Jun 24 08:56:40.375940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 763/1638] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:40.417297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:40.417940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:40.424350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.424791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.425542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.425997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.485932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:40.494034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-43a979b6-dd9c-431a-a400-775389948f8f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081069 Jun 24 08:56:40.494595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 876/1639] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:40 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:40.759405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:40.760049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:40.770944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.771388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.772709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.773410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.892341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:40.893396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:40.900727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.901163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.901963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:40.902397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:40.928799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:40.934182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e0cf4297-6427-4e79-96da-64117649a3da tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Jun 24 08:56:40.934768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 877/1640] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:40.937155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-805e5089-c6c0-44e6-8000-37f616a32e37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.181586 Jun 24 08:56:40.937833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 764/1641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:41.387544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:41.388454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:41.394449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.394898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.395644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.396069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.425350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6861d74b-f492-4636-af0d-a761e152d188 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041878 Jun 24 08:56:41.426047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 878/1642] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:41.511950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:41.512752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:41.519104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.519565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.520310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.520739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.581186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:41.588835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bdd64509-9937-4e4f-b917-10e5d48ad325 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080916 Jun 24 08:56:41.589394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 765/1643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:41.945977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:41.946839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:41.953051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.953497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.954289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.954715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.955031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:41.955650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:41.962079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.962538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.963318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:41.963759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:41.984473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d00ed3a-4ea4-41a7-ab68-490965d50aa6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042496 Jun 24 08:56:41.985039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 879/1644] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:42.094490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:42.102402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-75fe2792-4351-46df-bd91-636d4c03c148 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151271 Jun 24 08:56:42.102961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 766/1645] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:42.437908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:42.438827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:42.446147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:42.446604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:42.447372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:42.447809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:42.479615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fd440831-5843-4374-9d97-c8c6484854b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045647 Jun 24 08:56:42.480181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 880/1646] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:42.606539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:42.607156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:42.614109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:42.614551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:42.615331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:42.615769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:42.679323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:42.687093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-25fb161a-2a07-4ac2-b456-8a3eb957ba37 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084950 Jun 24 08:56:42.687664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 767/1647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:42 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:42.996825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:42.997785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:43.003958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.004407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.005166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.005599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.034993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cfa23ca-34df-441a-aa0e-108cf281e7a9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 Jun 24 08:56:43.035553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 881/1648] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:43.119865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:43.120463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:43.126455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.126901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.127689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.128121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.270782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:43.278488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9599598d-77ba-4389-8709-c9024bda5f4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.162981 Jun 24 08:56:43.279069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 768/1649] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:43.492183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:43.493100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:43.500041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.500516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.501293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.501761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.532456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f6cc51cc-51f3-4043-b880-b164f0299888 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044911 Jun 24 08:56:43.532939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 882/1650] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:43.704320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:43.704955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:43.711913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.712356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.713108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:43.713542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:43.775000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:43.782729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2821305e-73b1-434d-84e6-6ef4d4be36fc tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082196 Jun 24 08:56:43.783244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 769/1651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:44.046051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:44.046883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:44.053957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.054402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.055149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.055578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.057971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:44.086528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3faee94c-bce3-485a-94ef-d20106c4daa4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Jun 24 08:56:44.087097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 883/1652] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:44.295764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:44.296419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:44.302398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.302840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.303628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.304054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.433573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:44.441059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-87f87d0c-c1ee-4212-8594-5f8c8c24b501 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149286 Jun 24 08:56:44.441623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 770/1653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:44.544164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:44.545085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:44.551474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.551869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.552624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.554078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.582616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7c56055-fbb5-4804-b2aa-a87e8d7a61fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042426 Jun 24 08:56:44.583168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 884/1654] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:44.799650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:44.800407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:44.807689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.808065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.808833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:44.809344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:44.871823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:44.879241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d99beed9-0780-40a2-b25a-4526bd7ea59e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083596 Jun 24 08:56:44.879935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 771/1655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:45.098785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:45.099664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:45.106680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.107131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.107897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.108331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.138015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d6297746-334b-4709-ad34-65f375851bbc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043270 Jun 24 08:56:45.138591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 885/1656] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:45.458957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:45.460051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:45.466295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.466739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.467494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.467925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.593577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:45.594648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:45.596577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:45.598219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:45.602044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.602493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.603263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.603697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.605790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e3438686-8a6b-47b6-8c3f-d1e9c9fee627 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150837 Jun 24 08:56:45.613247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 772/1657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:45.636020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cac6e822-5d63-4cee-9d03-4b904f19e749 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046406 Jun 24 08:56:45.636579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 886/1658] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:45.895975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:45.896595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:45.904194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.904664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.905439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:45.905979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:45.969276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:45.976773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ad4f9f5d-0f04-4f5f-8a64-7dd43f366e80 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084670 Jun 24 08:56:45.977339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 773/1659] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:46.150312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:46.151190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:46.157959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.158411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.159184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.159624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.190193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d6c60052-5f8e-4b7c-b6f1-3d593c399831 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044231 Jun 24 08:56:46.190770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 887/1660] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:46.624506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:46.625113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:46.631210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.631819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.632646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.633170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.649201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:46.650198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:46.656210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.656658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.657427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:46.657898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:46.688109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-645b1722-578e-402f-a68e-26fdb736eb3c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044070 Jun 24 08:56:46.688684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 888/1661] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:46.767043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:46.775333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8296c72-7520-45b1-b4fe-cd8b920ca6b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154713 Jun 24 08:56:46.775896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 774/1662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:46.994375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:46.994894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:47.000829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.001276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.002101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.002533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.070903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:47.078475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-beab5800-589e-4862-a676-0fd77d956c5f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088667 Jun 24 08:56:47.079031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 889/1663] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:46 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:47.202590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:47.203520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:47.209939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.210387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.211251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.211689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.245185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f75d21aa-841e-462c-8970-99ecfa71cc17 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Jun 24 08:56:47.245580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 775/1664] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:47.700135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:47.701044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:47.707491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.707933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.708684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.709110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.739694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c4a47206-d766-433e-b6a9-921190d1ea5f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043655 Jun 24 08:56:47.740283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 890/1665] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:47.793150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:47.793857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:47.799906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.800333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.801095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:47.801528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:47.929227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:47.944729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-608e355a-34f2-4ae9-9170-d6cb198b0370 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155454 Jun 24 08:56:47.945294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 776/1666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:48.095491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:48.096090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:48.102209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.102654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.103408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.103837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.163924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:48.171503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-446c493f-5a99-44d4-8486-b7a87b3fb19e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079939 Jun 24 08:56:48.172061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 891/1667] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:48.257286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:48.258265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:48.264622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.265065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.265851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.266299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.268599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:48.296077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-afcaa739-f48c-416a-9b3d-739801956bcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Jun 24 08:56:48.296639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 777/1668] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:48.752163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:48.753089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:48.759725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.760173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.760939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.761372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.791545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b69354a0-686e-40d5-a00f-878e2059f44e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043351 Jun 24 08:56:48.792101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 892/1669] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:48.963211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:48.963771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:48.969899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.970350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:48.971323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:48.971759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.110185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:49.118066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7bfd2d68-1b8b-4e79-ad2f-e683b525d4d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159312 Jun 24 08:56:49.118637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 778/1670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:49.188703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:49.189304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:49.195357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.195799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.196558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.196984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.257879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:49.265397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fad4420d-f4fb-46c4-9fc0-57a7c3f72868 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080842 Jun 24 08:56:49.265983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 893/1671] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:49 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:49.306711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:49.307698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:49.313848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.314297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.315057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.315511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.344364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-64ee5ad2-3901-4f14-af3f-d2486f7c372b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041682 Jun 24 08:56:49.344917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 779/1672] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:49.804032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:49.804956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:49.811465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.811917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.812678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:49.813109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:49.844082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e6a19b9-7522-4c29-8e61-eb19c7493a79 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044559 Jun 24 08:56:49.844644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 894/1673] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:50.136065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:50.136922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:50.143307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.143750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.144514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.144971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.283990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:50.284610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:50.285236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:50.294095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.294491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.294682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2aa917b9-7e5d-466c-8c5d-c275556b18f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163013 Jun 24 08:56:50.295601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 780/1674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:50.295825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.296705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.355618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:50.356693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:50.359179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:50.364046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:50.365058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.365506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.366328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.366766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.372238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4172f744-12de-49cb-b782-04e06c8b5edd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091681 Jun 24 08:56:50.372824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 895/1675] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:50.400646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6420f71a-59a7-4dfd-8bfb-0bc8e1d665d8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048979 Jun 24 08:56:50.401134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 781/1676] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:50.856430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:50.857339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:50.863821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.864262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.865014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:50.866273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:50.894586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bfe8104e-c998-4968-9e56-671aef2359d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042129 Jun 24 08:56:50.895316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 896/1677] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:51.312009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:51.312619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:51.318666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.319110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.319885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.320300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.389738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:51.390345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:51.396506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.397484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.398533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.399417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.475971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:51.479481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:51.483836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e708d5ba-0781-4ee0-a2da-9b49dccac156 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.097950 Jun 24 08:56:51.484436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 897/1678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:51 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:51.487349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b64525d-6246-40cd-9dd2-905f04d9116c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.179156 Jun 24 08:56:51.488093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 782/1679] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:51.489129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:51.490092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:51.496377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.496830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.497603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.498063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.527979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-276c4ff2-21fb-447c-b089-617126265cf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042484 Jun 24 08:56:51.528549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 898/1680] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:51.910915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:51.912532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:51.922679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.923494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.924909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:51.925651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:51.971456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ac9e7198-40c8-425f-a575-a1c3cbaf66ea tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067968 Jun 24 08:56:51.972046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 783/1681] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:52.500949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:52.501562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:52.504925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:52.505563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:52.508766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.509214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.510024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.510460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.512488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.512965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.513772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.514205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.600756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:52.603051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:52.610903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c5455085-646b-4c40-b30d-56c2051a3982 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.113786 Jun 24 08:56:52.611547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 899/1682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:52 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:52.617228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:52.618201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:52.624852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.625307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.626143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.626772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.658241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dc5d2327-98c9-4a31-bd3c-db559f97290f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Jun 24 08:56:52.658834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 900/1683] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:52.702598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:52.711176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-23ade277-b32b-4574-80bf-5d59c22b60b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.210083 Jun 24 08:56:52.711765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 784/1684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:52.983489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:52.984469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:52.991046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.991498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:52.992292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:52.992724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.023000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b8861bde-5812-4c57-a056-8e1070e7d414 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043230 Jun 24 08:56:53.023573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 901/1685] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:53.632448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:53.633049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:53.639516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.639954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.640711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.641142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.669690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:53.670621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:53.677190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.677639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.678435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.678878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.702504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:53.707478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e3b7794-c988-4482-861a-678aba9a1a80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041683 Jun 24 08:56:53.708051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 902/1686] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:56:53.711226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4f961b5d-e969-408d-bf0d-82c775970afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082631 Jun 24 08:56:53.711780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 785/1687] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:53.728743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:53.729351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:53.735395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.735842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:53.736599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:53.737031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.040295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:54.044194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:54.055772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.056890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.058619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.059330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.111045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c45698fd-c0ec-4705-a630-c2bc6a8be660 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078460 Jun 24 08:56:54.112065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 786/1688] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:56:54.114417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:54.122401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a2dc9fce-7605-45d4-964b-9f8e3f82fb71 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.398061 Jun 24 08:56:54.122973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 903/1689] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:54.719743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:54.720768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:54.727759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:54.728377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.728491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:54.728887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.729712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.730154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.735447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.735925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.737017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:54.737457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:54.761870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7dc13868-ebc3-4fb3-a6cd-81c374959aa0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Jun 24 08:56:54.762450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 787/1690] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:54.802199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:54.810979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7843d936-e169-409f-9ae6-ba27cdd78c30 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087557 Jun 24 08:56:54.811472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 904/1691] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:55.122896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:55.123734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:55.129713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.130160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.130930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.131999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.140350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:55.140985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:55.146965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.147412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.148442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.148871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.161514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8a565145-1099-40e7-a939-f6da4f08d0e7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042598 Jun 24 08:56:55.162183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 788/1692] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:55.278218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:55.285736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aad0d64a-4c41-4285-b5a6-d5c7eb94fd25 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149223 Jun 24 08:56:55.286267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 905/1693] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:56:55.774518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:55.775458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:55.782063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.782514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.783286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.783725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.812781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-992a6de0-eb8e-4b35-980f-2cb89e0bacf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043015 Jun 24 08:56:55.813343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 789/1694] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:55.828287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:55.828890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:55.835927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.836371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.837313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:55.837784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:55.903601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:55.911513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e46791d-31b8-4600-b6a5-bf00758e3506 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087399 Jun 24 08:56:55.912088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 906/1695] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:55 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:56.173458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:56.174307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:56.180405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.180849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.181608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.182073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.211883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5ad9331c-2963-458e-bd97-a27653f64626 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042453 Jun 24 08:56:56.212442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 790/1696] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:56.303098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:56.303702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:56.309697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.310145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.310892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.311318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.443650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:56.451872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3a174a46-0722-4d3f-bf7c-cdd823b31b29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152614 Jun 24 08:56:56.452439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 907/1697] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:56.824067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:56.825057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:56.831742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.832179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.832961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.833399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.863349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bbd2b90d-36ab-4e89-8d53-cc3d9e5b9322 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 Jun 24 08:56:56.863917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 791/1698] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:56.929333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:56.929983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:56.936574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.937019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:56.937827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:56.938256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.000114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:57.007902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40d08430-02c5-4aa3-8418-9d695819e738 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082997 Jun 24 08:56:57.008483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 908/1699] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:56 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:57.223780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:57.224611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:57.231272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.231712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.232467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.232893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.260676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2477a93a-f6ee-45d1-b6e4-299e063a44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040909 Jun 24 08:56:57.261224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 792/1700] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:57.468990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:57.469597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:57.476684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.477067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.477867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.478301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.606422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:57.614226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4bac07e3-10cc-4327-b233-2c19de3ac213 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148908 Jun 24 08:56:57.614796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 909/1701] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:57.875828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:57.876750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:57.884120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.884674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.885448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:57.885912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:57.910299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:57.915567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f50758a5-6de0-426c-ac23-83991b9a547d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Jun 24 08:56:57.916201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 793/1702] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:58.026094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:58.026728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:58.033721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.034200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.034996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.035425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.097313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:58.104939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f473988-6ed2-4840-977f-ee5edf24167c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083032 Jun 24 08:56:58.105503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 910/1703] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:58.272384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:58.273611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:58.279865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.280316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.281122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.281563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.311691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-67050b3f-f570-459b-b928-2b9e5bc2fd8c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043324 Jun 24 08:56:58.312261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 794/1704] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:58.631468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:58.632075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:58.638220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.638669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.639437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.639872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.777870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:58.785565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-99e2eff7-b8f7-4578-ac7e-a28e74ac902a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158003 Jun 24 08:56:58.786264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 911/1705] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:58.927888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:58.929265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:58.936470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.936954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.937877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:58.938342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:58.968326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3a725b0d-b532-4370-baf5-fc0193530a93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Jun 24 08:56:58.968889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 795/1706] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:56:59.122519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.123124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.129947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.130389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.131170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.132108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.199527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:59.212491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b48397f3-3921-4dd6-a817-2756e8bbd1fb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.093874 Jun 24 08:56:59.213073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 912/1707] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:59 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:59.324352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.325273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.331292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.331737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.332514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.332943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.363320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b512266c-0777-4247-b53a-3e637d3759cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042984 Jun 24 08:56:59.363878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 796/1708] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:56:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:56:59.802569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.803213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.810031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.810490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.811290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.811730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.949374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:56:59.957173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aafcfb9f-4919-41a0-bf6f-fa3cbe08ca36 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158536 Jun 24 08:56:59.957787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 913/1709] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:56:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:56:59.980183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:56:59.981123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:56:59.987922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.988367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:56:59.989245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:56:59.989722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.031074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9e9269b6-7598-46d8-ad49-72a909664ae9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054761 Jun 24 08:57:00.031691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 797/1710] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:56:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:00.229822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:00.230420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:00.236864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.237311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.238189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.238623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.309202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:00.316795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-96d051dd-2310-4a01-95b8-9d6f3f4bb494 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091427 Jun 24 08:57:00.317361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 914/1711] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:00.376369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:00.377395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:00.384675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.385131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.385955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.386395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.422111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0529d0f0-bc67-4b11-9ebb-2838337697cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049927 Jun 24 08:57:00.422717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 798/1712] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:00.976241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:00.976756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:00.983147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.983592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:00.984363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:00.984804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.044242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:01.045198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:01.052673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.053164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.054508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.054963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.088027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7040f4ce-1a66-4c91-8793-6e19a64e1cbd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047829 Jun 24 08:57:01.088958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 799/1713] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:01.133362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:01.141552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ce275f56-0549-42bf-b421-cd751eea4737 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.169986 Jun 24 08:57:01.142183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 915/1714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:01.333195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:01.333851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:01.340246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.340696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.341474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.341939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.404777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:01.413324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96e04eae-0499-4763-b20b-f38a8d86e7b7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083439 Jun 24 08:57:01.413988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 800/1715] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:01.433916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:01.434831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:01.441411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.441924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.442652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:01.443081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:01.458054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:01.474588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c871832c-e1af-402c-b15f-d36110681029 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044712 Jun 24 08:57:01.475654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 916/1716] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:02.102452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:02.103376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:02.110138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.110590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.111377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.111814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.142910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a291a1e8-51e6-4e3b-93b8-1e6bb8525e6a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Jun 24 08:57:02.143394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 801/1717] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:02.160301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:02.160919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:02.167185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.167621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.168391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.168817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.309941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:02.322683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d72f9a65-e0b4-4ea0-9530-e1c1d1fa2663 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.167173 Jun 24 08:57:02.323274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 917/1718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:02.430383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:02.430912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:02.437183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.437745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.438456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.438898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.487082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:02.488047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:02.495541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.495983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.496753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:02.497179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:02.509949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:02.517554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-51caefca-85a6-453c-9985-306500e10746 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.091614 Jun 24 08:57:02.518182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 802/1719] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:02 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:02.529626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-25e899a5-1082-456d-ad63-bfee72b42eb6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046735 Jun 24 08:57:02.530225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 918/1720] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:03.156483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.157330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.164574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.165018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.165809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.166241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.194663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d64f86b8-7a53-478d-af7b-39b42177e426 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Jun 24 08:57:03.195215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 803/1721] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:03.340526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.341138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.347189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.347635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.348393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.348826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.476880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:03.484414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8787193f-fab4-4719-9cd4-7bc6f04fdc68 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147797 Jun 24 08:57:03.484985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 919/1722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:03.535546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.536152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.540514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:03.541486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:03.542724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.543184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.543964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.544402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.547907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.548349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.549111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:03.549541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:03.579093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-560477e7-b8af-4a22-a019-a7395650408b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042648 Jun 24 08:57:03.579871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 920/1723] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:03.606471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:03.614499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b81ef83a-e00e-4e24-b75c-e4fc4f108968 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083107 Jun 24 08:57:03.615080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 804/1724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:03 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:04.206321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:04.207243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:04.213344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.213818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.214578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.215007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.245856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c61954fd-1b20-4eb5-a59a-c466844fc44f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Jun 24 08:57:04.246980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 921/1725] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:04.501824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:04.502377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:04.509361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.509830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.510586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.511073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.591810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:04.592738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:04.599408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.599883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.600697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.601128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.631938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac8c3cf9-f130-4f7a-8c3f-490770fc16ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043733 Jun 24 08:57:04.636026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 922/1726] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:04.638450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:04.639058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:04.645503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.646158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.646585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:04.646984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:04.647667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:04.654578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c8b6f92d-65ab-4809-9b9b-8cfd929e4fd3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156777 Jun 24 08:57:04.655333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 805/1727] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:04.707875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:04.715883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-213f7fe5-a565-4da4-958f-7dd10ca815e7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081872 Jun 24 08:57:04.716452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 923/1728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:04 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:05.257532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:05.258508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:05.264579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.265028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.265944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.266382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.295026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-507171d0-524d-4418-8205-5a98dd88dbfc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041945 Jun 24 08:57:05.295584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 806/1729] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:05.644136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:05.645053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:05.652234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.652656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.653471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.653968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.672164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:05.672947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:05.681168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.682000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.682785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.683232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.690898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dff4d856-3ac7-46a7-9d5d-dc2ea70b34cd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050694 Jun 24 08:57:05.691491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 924/1730] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:05.733738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:05.734349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:05.744361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.744817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.745705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:05.746159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:05.833527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:05.841072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5edec7eb-68b5-452c-8cb2-e3ccfaefb257 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.111579 Jun 24 08:57:05.841643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 925/1731] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:05.861022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:05.869220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7cd0c70d-ae63-4a12-9bc2-253afa950838 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.201208 Jun 24 08:57:05.869740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 807/1732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:06.306447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:06.307367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:06.313378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.313856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.314611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.315034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.343336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8178922-b2be-4163-a76e-8ad0d0a345c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041164 Jun 24 08:57:06.343882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 926/1733] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:06.704606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:06.705543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:06.712979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.713432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.714247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.714694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.743773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fbdccf8c-6f44-451a-bf79-cca622ceb9e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043179 Jun 24 08:57:06.744334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 808/1734] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:06.859753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:06.860296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:06.867384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.867829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.868601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.869030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.886999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:06.887773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:06.893967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.894689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.895273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:06.896016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:06.942498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:06.951156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4691ef94-944e-4e57-85f1-e43f9572bbdb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.095414 Jun 24 08:57:06.951740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 927/1735] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:07.035848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:07.044029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-288d36df-f0fb-474b-a94a-9db06ac635a7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161023 Jun 24 08:57:07.044599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 809/1736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:07.356969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:07.357933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:07.364908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.367507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.368334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.368771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.400012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-05b48ad4-e113-4eec-9655-719beebda5e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046979 Jun 24 08:57:07.400563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 928/1737] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:07.755702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:07.756630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:07.763141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.763561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.764359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.764797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.779153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:07.796058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-36d47f7f-4c57-4ced-8d48-aed2af5a315b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044259 Jun 24 08:57:07.796623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 810/1738] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:07.968005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:07.968534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:07.975633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.976075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:07.976824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:07.977253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.042104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:08.050229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9eca0325-f31c-454d-9f8c-dc9bbb7df041 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085840 Jun 24 08:57:08.050484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 929/1739] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:08.061457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:08.062097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:08.068066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.069300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.069828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.070270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.199979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:08.207695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5047da2c-2c1d-4022-be1e-9789241454a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150041 Jun 24 08:57:08.208257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 811/1740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:08.410784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:08.411805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:08.418128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.418581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.421023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.421512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.452162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c85d570e-7653-4c6c-9513-9c781cf29ea8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045326 Jun 24 08:57:08.452719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 930/1741] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:08.807843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:08.808768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:08.815366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.815859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.816578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:08.817138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:08.847079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a5439348-b25b-4eec-a672-c05782b6b1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043194 Jun 24 08:57:08.847637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 812/1742] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:09.066634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:09.067236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:09.074242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.074687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.075439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.075869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.139639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:09.147274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7dab610f-0278-4a26-be95-d2b6bcf595af tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084551 Jun 24 08:57:09.148107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 931/1743] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:09 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:09.224216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:09.224820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:09.230831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.231278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.232038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.232467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.361597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:09.369615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0bf0365e-ea5e-412b-9153-ac3781acf69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149225 Jun 24 08:57:09.370207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 813/1744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:09.463857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:09.464779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:09.470785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.471228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.471994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.472425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.500455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e18b5033-bf1d-40b1-9dc0-5df26488f7ed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040492 Jun 24 08:57:09.500999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 932/1745] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:09.859124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:09.860131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:09.867558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.867921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.868693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:09.869126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:09.899661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d8cd4826-993c-49ea-8193-661a42d18740 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Jun 24 08:57:09.900227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 814/1746] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:10.164524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.165134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:10.171763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.172212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.172983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.173423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.176142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:10.238116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:10.246900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef271153-7ebc-440f-a796-dbb2f36dc3dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086463 Jun 24 08:57:10.247482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 933/1747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:10.387691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.388237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:10.394447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.394889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.395653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.396081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.512264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.513250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:10.520930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.521379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.522211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.522907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.547246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:10.555261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-987b1c23-8aff-497f-86f4-0af52298130f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046939 Jun 24 08:57:10.555959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 934/1748] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:10.556834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-29c609d9-f5c2-4b39-9214-e043eec06ddd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.173207 Jun 24 08:57:10.560013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 815/1749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:10.911546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:10.913106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:10.919379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.919822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.920602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:10.921060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:10.951591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f7191af2-47a4-420c-b6d0-22f9a866335b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Jun 24 08:57:10.952179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 935/1750] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:11.264483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:11.265367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:11.272512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.273239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.274032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.274466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.340833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:11.348983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cba62572-22f4-4e8b-bf32-72ac4a221646 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088311 Jun 24 08:57:11.349452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 816/1751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:11.567200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:11.568039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:11.570527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:11.574740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:11.575582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:11.576026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.576478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.577256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.577705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.582357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.582802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.583580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.584004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.609785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0273c36c-636d-4e9b-922d-fe4d2ce8fb80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Jun 24 08:57:11.610568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 936/1752] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:11.731772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:11.739497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09144d0a-de5d-465c-ae55-1cd877a8a597 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.168946 Jun 24 08:57:11.740074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 817/1753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:11.964272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:11.965110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:11.971385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.971829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:11.972598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:11.973031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.002444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-19bc1d66-c980-4c52-a24c-7b2471672792 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042899 Jun 24 08:57:12.003006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 937/1754] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:12.367204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:12.367834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:12.374457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.374904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.375676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.376107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.440325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:12.449649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9d1a54d6-0c2d-4f06-b38f-dd84b9198148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087062 Jun 24 08:57:12.450254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 818/1755] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:12.620683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:12.621619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:12.628395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.628843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.629603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.630070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.661024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46423573-2fb0-4c3e-82ed-89a7cb8a731f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044349 Jun 24 08:57:12.661589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 938/1756] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:12.757026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:12.757632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:12.763699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.764473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.765253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:12.765707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:12.907764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:12.915640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-69dfb42b-90b7-4c1c-8500-0bebe57d206d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163084 Jun 24 08:57:12.916222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 819/1757] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:13.015677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:13.016846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:13.024043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.024492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.025277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.025782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.057591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7718b40d-1c9f-4381-8a69-9006b98e6641 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046657 Jun 24 08:57:13.058193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 939/1758] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:13.468677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:13.469274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:13.476640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.477090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.477923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.478360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.542344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:13.550349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-129c9d76-a958-4369-af27-9c57b9ab0afb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085510 Jun 24 08:57:13.550929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 820/1759] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:13 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:13.672928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:13.673894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:13.680393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.680851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.681623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.682090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.711608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-23037f52-dc8a-463b-9d74-9c8d6731ac5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042624 Jun 24 08:57:13.712180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 940/1760] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:13.933571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:13.934213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:13.940395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.940840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:13.941601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:13.942063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.070595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:14.071533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:14.078292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:14.079942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.080425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.081236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.081697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.089400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-492191f4-c997-4c9f-b7d7-3198bd17de2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159586 Jun 24 08:57:14.090362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 821/1761] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:14.115992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b5037d1d-c5a6-4b69-bee8-0664deca4436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050151 Jun 24 08:57:14.116562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 941/1762] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:14.568403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:14.569028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:14.576372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.576822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.577599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.578060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.648745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:14.659045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3febc744-de7a-43a4-966d-59e54525fc18 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.094808 Jun 24 08:57:14.659632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 822/1763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:14.723903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:14.724840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:14.732079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.732527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.733312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:14.733779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:14.768221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b4df968c-9c52-45e8-9cb7-efdbef06b2d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048171 Jun 24 08:57:14.769256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 942/1764] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:15.108851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:15.109487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:15.115767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.116742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.117507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.117984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.128368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:15.129309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:15.140924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.141379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.142191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.142638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.185170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-15217b5c-467c-479e-9638-87719913744d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061131 Jun 24 08:57:15.185813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 943/1765] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:15.268339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:15.276334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fffd7081-e694-430e-bfff-9914944c498f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.171641 Jun 24 08:57:15.276910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 823/1766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:15.676430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:15.677027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:15.683092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.683537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.684295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.684723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.746324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:15.753961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c9ae841c-fd66-4d35-846b-3bfb5466e1a9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081320 Jun 24 08:57:15.754528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 944/1767] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:15 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:15.783329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:15.784263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:15.790890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.791337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.792114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:15.792552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:15.823722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f3b4c390-6e70-40e3-87d2-94af275fe9c8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Jun 24 08:57:15.824294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 824/1768] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:16.197632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:16.198472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:16.204992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.205450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.206258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.206699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.236729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1c78613b-5181-435e-8954-c99b1974fce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044057 Jun 24 08:57:16.237301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 945/1769] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:16.294210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:16.294825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:16.300953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.301403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.302203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.302641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.443576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:16.451839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6755e4a1-1e87-4bb7-a792-a0f47a385c26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161413 Jun 24 08:57:16.452355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 825/1770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:16.772969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:16.773860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:16.780207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.780662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.781436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.781912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.837321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:16.838366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:16.845199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.845685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.846471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:16.846698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:16.846907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:16.855179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d692c4a9-d2a4-4765-8899-99e1a2451de0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086547 Jun 24 08:57:16.855760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 946/1771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:16 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:16.878923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-38b22c77-772d-4a39-9856-eb3e3d281abb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046565 Jun 24 08:57:16.879494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 826/1772] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:17.248706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:17.249543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:17.256107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.257135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.257985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.258423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.291005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-84b9d7d0-224d-44a6-b461-a8ba80b83b0c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046336 Jun 24 08:57:17.291593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 947/1773] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:17.469515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:17.470170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:17.476667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.477114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.477931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.478371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.481100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:17.613064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:17.621036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9fc6e9e0-635e-4ee9-83ba-4e088aeaad18 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155332 Jun 24 08:57:17.621605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 827/1774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:17.874029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:17.874593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:17.880899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.881354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.882695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.883163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.890889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:17.892020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:17.899614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.900065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.900843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:17.901265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:17.930653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c4a4f7f-c4f9-4532-b266-1e0e1a302c50 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Jun 24 08:57:17.931494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 828/1775] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:17.948749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:17.956532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-277441e2-0f45-4ad4-9415-750b126e4e60 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087150 Jun 24 08:57:17.957088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 948/1776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:18.305288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:18.306247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:18.312391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.312837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.313605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.314071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.343544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c2da85bf-37b2-49f4-bc1e-73c2bd2b099c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042889 Jun 24 08:57:18.344106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 829/1777] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:18.638772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:18.639373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:18.645930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.646374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.647122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.647805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.776738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:18.778949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:18.785367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7a427a1-ec89-4a08-8a50-47b390d63e49 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150472 Jun 24 08:57:18.785965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 949/1778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:18.943287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:18.944220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:18.951161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.951616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.952393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.952831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.974106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:18.974812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:18.981495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.981987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.982775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:18.983179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0800d6cd-5977-47f8-a8e8-68392e3ae2a2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Jun 24 08:57:18.983312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:18.983769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 830/1779] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:19.046280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:19.054115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06016d0d-d663-4b49-bb12-eeb61249f092 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084167 Jun 24 08:57:19.054707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 950/1780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:19.354702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:19.355630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:19.357531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:19.362838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:19.363290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:19.364055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:19.364492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:19.406217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4ed3b647-92f8-4258-a29e-8cd83936f8f3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055661 Jun 24 08:57:19.406796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 831/1781] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:19.807150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:19.807758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:19.814306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:19.814757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:19.815521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:19.815977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:19.952467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:19.960474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a012f3f0-9a3c-4722-8435-d79ad895e2b0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159392 Jun 24 08:57:19.961042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 951/1782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:19.995364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:19.996285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.002572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.003012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.003768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.004198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.033622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ec781d57-a1a1-4fb1-b5ad-f3a7ba8325dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042717 Jun 24 08:57:20.034222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 832/1783] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:20.070826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:20.071434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.077466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.077930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.078697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.079141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.290237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:20.297785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47ed2dfa-f9f0-4303-850f-46080adaaf57 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.230757 Jun 24 08:57:20.298369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 952/1784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:20.418394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:20.419326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.426119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.426600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.427382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.427868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.459407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d23141c1-801e-420a-9605-9bca25e5d9ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045194 Jun 24 08:57:20.460067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 833/1785] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:20.978077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:20.978665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:20.985215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.985678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:20.986443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:20.986876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.044660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:21.045617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:21.051739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.052191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.054135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.054135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.088853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f2a7f174-f27a-49c4-80b0-d3be10152ea9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048123 Jun 24 08:57:21.089584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 834/1786] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:21.127380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:21.135655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7289982-a60c-4c55-83d8-75f0a37332d7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161635 Jun 24 08:57:21.136277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 953/1787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:21.314512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:21.315157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:21.321806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.322250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.323015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.323447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.386742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:21.394852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-de574719-f89e-4342-8503-3ee8ebc42d63 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084140 Jun 24 08:57:21.395418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 835/1788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:21.471288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:21.472262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:21.482544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.483084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.483897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:21.484333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:21.514663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a0d5aae-1906-47fa-bec7-5d86ca6ed953 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047331 Jun 24 08:57:21.515218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 954/1789] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:22.101375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.102370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.111794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.111794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.111794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.111794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.140190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7af8550-5493-40b9-ba01-7dc2cef08fb6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 Jun 24 08:57:22.140761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 836/1790] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:22.153445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.154254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.161166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.161612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.162678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.163179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.294673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:22.302352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32d36b4d-008a-420a-b97d-2f0043ca4f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153510 Jun 24 08:57:22.302911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 955/1791] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:22.411859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.412390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.418627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.419072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.419838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.420272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.498857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:22.506627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-72627d5f-21d3-4c5c-b631-a07467f95e22 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098665 Jun 24 08:57:22.507241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 837/1792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:22.526888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:22.527963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:22.534531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.534982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.535768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:22.536206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:22.567033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8c78f279-4c60-4846-b97d-fdfb797da2d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Jun 24 08:57:22.567590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 956/1793] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:23.063617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:57:23.063891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:57:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 08:57:23.153267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:23.154234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:23.161039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.161483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.162287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.162720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.192843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8deba73e-a969-44ab-a71c-2cd5a7f192d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Jun 24 08:57:23.193393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 838/1794] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:23.320254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:23.320807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:23.327395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.327837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.328599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.329027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.462977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:23.470501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d039c2a-aed3-4d3d-abf2-28dc9727acc9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154729 Jun 24 08:57:23.471081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 957/1795] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:23.524550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:23.525165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:23.532455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.533009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.533982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.534509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.579919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:23.580773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:23.587589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.588045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.588825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:23.589262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:23.598684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:23.607409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3e75f508-9655-49f1-9dea-e2a534ddd576 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087561 Jun 24 08:57:23.608697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 839/1796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:23 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:23.623640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c154d5e2-c84b-43c8-90ff-5fea1a8bdcf0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047784 Jun 24 08:57:23.624220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 958/1797] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:24.206087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:24.207116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:24.214337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.214785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.215559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.215995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.246513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5b50ab2-cb7a-45b8-bef3-d020267ba78b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044662 Jun 24 08:57:24.247304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 840/1798] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:24.488361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:24.488939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:24.495971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.496412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.497164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.497590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.624893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:24.625565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:24.625721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:24.632081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.632530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.643831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a91ac33-8957-4064-a297-86169c7a3ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148779 Jun 24 08:57:24.644554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.644554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.644754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 959/1799] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:24.644754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:24.644754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:24.648041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.648482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.649604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:24.650076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:24.679755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2f789f98-cc9b-4a3f-bd26-5fcd8af8eb69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044462 Jun 24 08:57:24.680914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 960/1800] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:24.704264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:24.711865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24a6ddf0-822d-41ba-81b6-de38f65248d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.090949 Jun 24 08:57:24.712421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 841/1801] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:25.259909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:25.260834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:25.266910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.267357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.268121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.268622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.299993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-045a731f-8adf-4560-9c13-b4ef0534296a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 Jun 24 08:57:25.300546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 961/1802] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:25.651894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:25.652485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:25.659567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.660009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.660766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.661196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.692040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:25.692960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:25.700475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.700922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.701717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.702148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.731863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0e5a1ab2-3cbf-46fe-9d9a-5a66928bb719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043691 Jun 24 08:57:25.732423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 962/1803] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:25.736934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:25.737807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:25.744095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.744549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.745330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:25.745813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:25.799879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:25.808224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4c349589-d759-4094-93ad-222201f492a3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160536 Jun 24 08:57:25.808798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 842/1804] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:25.815776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:25.824018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a9b60d6b-cb7c-493e-ab9e-9b456757a78b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.090647 Jun 24 08:57:25.824569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 963/1805] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:26.312734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:26.313724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:26.320454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.320889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.321687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.322128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.347892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:26.353651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fd24ef4c-7831-49be-b7e2-f001ff85a9e7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Jun 24 08:57:26.354243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 843/1806] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:26.743757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:26.744653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:26.751646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.752088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.752852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.753282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.785366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-94eed268-d759-417e-93db-ad592c42a167 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045704 Jun 24 08:57:26.785960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 964/1807] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:26.826311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:26.826918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:26.833263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.833646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.834428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.834859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.841005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:26.841619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:26.847659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.848127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.848876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:26.849342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:26.933233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:26.940784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c3779a48-6aa0-4d2d-9aa0-cfcc68c3e697 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.104307 Jun 24 08:57:26.941351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 965/1808] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:26.991693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:26.999295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3777ddc8-fc88-48ee-a137-74168f5ddaa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.177604 Jun 24 08:57:26.999853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 844/1809] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:27.365287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:27.366266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:27.373088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.373533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.374318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.374753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.389309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:27.405054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18b775ae-c69a-4c24-afe0-9b1204626853 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Jun 24 08:57:27.405619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 966/1810] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:27.797853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:27.798781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:27.805118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.805559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.807029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.807457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.838566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-139e270b-f8a5-41f3-8516-47a622371add tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044676 Jun 24 08:57:27.839244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 845/1811] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:27.958221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:27.958827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:27.970501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.970960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:27.971957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:27.972554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.016568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:28.017185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:28.024143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.025495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.026592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.026958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.045337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:28.054381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b3716e1-2ec6-4243-a4f7-1c15490a1148 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.099862 Jun 24 08:57:28.055300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 967/1812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:28.182170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:28.190230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c5cde67-ba85-4234-b12e-4284454c80b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.177551 Jun 24 08:57:28.190839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 846/1813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:28.417088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:28.417951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:28.424026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.424481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.425247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.425705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.455009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aaf25e77-0c0f-420c-a568-7b8742f176b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 Jun 24 08:57:28.455565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 968/1814] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:28.851137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:28.852550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:28.861851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.862298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.863069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:28.863496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:28.893954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d8427749-f704-4720-97cb-a753804142d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046857 Jun 24 08:57:28.894941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 847/1815] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:29.071824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:29.072453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:29.078978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.079422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.080180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.080609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.141600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:29.149770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f439420c-325a-40bd-865f-c7dfd5f2831c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081518 Jun 24 08:57:29.150326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 969/1816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:29 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:29.208281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:29.208893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:29.214922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.215373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.216135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.216602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.347846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:29.356090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78aee9fe-da9a-482a-ae5b-c31e8359ec33 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151684 Jun 24 08:57:29.356661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 848/1817] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:29.467002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:29.467870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:29.474439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.474904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.475680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.476116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.505222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a500293-a64e-4e8b-ac0a-9a929b82ea8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Jun 24 08:57:29.505807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 970/1818] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:29.906507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:29.907433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:29.914059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.914502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.915272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:29.915704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:29.945767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b600318-67fb-4c69-b8aa-334afeb6abfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Jun 24 08:57:29.946331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 849/1819] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:30.167324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:30.167880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:30.174465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.174919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.175698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.176138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.236942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:30.245153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85adfe5f-b3f5-4a4c-8ed1-c42bc466bc44 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081815 Jun 24 08:57:30.245746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 971/1820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:30.374135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:30.374775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:30.381135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.381579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.382395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.382856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.516588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:30.517521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:30.518876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:30.523803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.524246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.525281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.525730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.527026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-45549adc-d7a6-4c9c-b245-99826ca58f4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156754 Jun 24 08:57:30.527840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 850/1821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:30.555667 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56cf9c64-1d14-4c99-aeef-36e69d630085 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043022 Jun 24 08:57:30.556890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 972/1822] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:30.958275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:30.959220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:30.966562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.967004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.967781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:30.968212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:30.999522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-538e0bff-f4dd-4073-8f8c-6076fa03f36b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045311 Jun 24 08:57:31.000094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 851/1823] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:31.262818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:31.263369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:31.270042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.270498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.271251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.271680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.331787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:31.339899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-265eff89-c8cb-42e2-adfd-fe360a7f7a0d tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081561 Jun 24 08:57:31.340471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 973/1824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:31.544151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:31.544754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:31.551067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.551512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.552273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.552735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.567736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:31.568756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:31.575438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.575894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.576668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:31.577103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:31.605630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cbe58fa-7c7b-4f0a-a4f3-55c55d497df0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041806 Jun 24 08:57:31.609357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 974/1825] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:31.684454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:31.691886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d3803f04-8676-4818-a39f-43eed11ec295 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151565 Jun 24 08:57:31.692446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 852/1826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:32.010850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:32.011700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:32.017941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.018397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.019172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.019610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.049590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a293a32-5beb-4656-aade-ba6893eb45ab tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042760 Jun 24 08:57:32.050221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 975/1827] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:32.356922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:32.357521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:32.364170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.364617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.365375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.365840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.426098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:32.433496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24948a7e-ae49-4c8c-b09b-63357ecba794 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081070 Jun 24 08:57:32.434094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 853/1828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:32.616516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:32.617478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:32.625183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.625974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.627087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.627535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.657441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a40bb0c3-ead9-44f8-bd0e-f064908d7e0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Jun 24 08:57:32.658193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 976/1829] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 08:57:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:32.710260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:32.710866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:32.717672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.718131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.718900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:32.719335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:32.845912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:32.853362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b455df71-1ac5-4ba5-bbfb-37c5096fb75f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.146884 Jun 24 08:57:32.853958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 854/1830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:33.062527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:33.063455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:33.069428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.069924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.070695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.071133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.104963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-395c0d87-a7cc-482e-b5b0-34a291e4c2e0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046986 Jun 24 08:57:33.105531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 977/1831] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:33.450723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:33.451370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:33.458352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.458829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.459630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.460074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.521416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:33.529748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7056a4ec-7a22-4a16-a7d5-9e828c820280 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083009 Jun 24 08:57:33.530318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 855/1832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:33.669465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:33.670417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:33.676982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.677430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.678215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.678649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.773031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ea2f118d-9a62-44bb-9b94-91c1970dd8f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action" status: 200 len: 40940 microversion: 2.1 time: 0.107733 Jun 24 08:57:33.773696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 978/1833] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 08:57:33 2022] POST /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/action => generated 40940 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:33.793721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:33.794216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:33.800228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.800666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.801421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.801893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.870836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:33.871529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:33.878704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.879153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:33.879921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:33.880352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:34.011465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:34.019810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1254a7f7-c941-4929-b5da-affcca486eb7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153199 Jun 24 08:57:34.020586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 979/1834] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:34.118098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:34.118948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:34.125021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:34.125472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:34.126271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:34.126711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:34.156681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e5e32924-09ba-4c92-83e6-5e3742beb4a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043337 Jun 24 08:57:34.157241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 980/1835] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:34.546660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:34.547263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:34.553880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:34.554325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:34.555078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:34.555506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:34.616191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:34.624126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-16b802b8-3fdb-49cb-beff-e6b456cb45f9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081414 Jun 24 08:57:34.624678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 981/1836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:34 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:35.038343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:35.039683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:35.046457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.046895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.047664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.048097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.194584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:35.202279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8d7364a8-1319-4d9b-acb6-ea7b1cfb2f6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.168728 Jun 24 08:57:35.203028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 982/1837] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:35.207270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:35.207759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:35.213597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.214074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.215082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.215514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.230864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.244459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 08:57:35.320395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:35.329012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a77e1455-f45a-4d1a-9683-82eea874a95b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 204 len: 0 microversion: 2.1 time: 0.124895 Jun 24 08:57:35.329889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 983/1838] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 08:57:35 2022] DELETE /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 08:57:35.338632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:35.340314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:35.346274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.346722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.347525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.347911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.377786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d7c95db2-d9a6-4e96-9175-0f03b5351bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046574 Jun 24 08:57:35.378195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 984/1839] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:35.382464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:35.383066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:35.388500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.388942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.389728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.390162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.516365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:35.523738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-576fdfb7-1ed2-479d-aa67-cdc25406d19f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1683 microversion: 2.1 time: 0.144622 Jun 24 08:57:35.524297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 985/1840] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:35 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:35.641138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:35.641695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:35.647664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.648106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.648857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:35.649290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:35.709528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:35.717902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-860c44c9-81c0-4015-917d-95494dd9ab1e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080772 Jun 24 08:57:35.718466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 986/1841] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:35 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:36.219530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:36.220234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:36.226616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.227059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.227806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.228233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.366071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:36.374336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21ebfa21-8298-4ce9-9dfa-efbe70ec287a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158756 Jun 24 08:57:36.374910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 987/1842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:36.389401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:36.390445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:36.396976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.397513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.398403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.398908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.429450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9bd9ac9e-8dd4-47b2-bc8d-a3f6ea2bbf7e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044535 Jun 24 08:57:36.430258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 988/1843] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 08:57:36.541156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:36.541734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:36.548264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.548769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.549532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.549982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.681606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:36.689797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7997ba23-ff9b-4fe1-b712-2e173f8742eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1683 microversion: 2.1 time: 0.152671 Jun 24 08:57:36.690371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 989/1844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:36 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:36.735111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:36.735724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:36.741852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.742302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.743062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:36.743499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:36.810508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:36.818490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f02911c-c36d-46b9-bfbf-192c22f01ff6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087281 Jun 24 08:57:36.819054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 990/1845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:37.241748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-9441f20b-3ffc-4685-889c-8c8c448a75d6 req-549a520a-03c1-4695-9cef-cd1886ff0c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e738abd4-3c88-4daf-a1a5-0ff726682731", "name": "network-vif-deleted", "tag": "35c95a9d-d09e-4021-b15c-16d9c3196a06"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:37.250036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9441f20b-3ffc-4685-889c-8c8c448a75d6 req-549a520a-03c1-4695-9cef-cd1886ff0c15 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.250485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9441f20b-3ffc-4685-889c-8c8c448a75d6 req-549a520a-03c1-4695-9cef-cd1886ff0c15 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.262477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-9441f20b-3ffc-4685-889c-8c8c448a75d6 req-549a520a-03c1-4695-9cef-cd1886ff0c15 service nova] Creating event network-vif-deleted:35c95a9d-d09e-4021-b15c-16d9c3196a06 for instance e738abd4-3c88-4daf-a1a5-0ff726682731 on hv-cinder-78729 Jun 24 08:57:37.268388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-9441f20b-3ffc-4685-889c-8c8c448a75d6 req-549a520a-03c1-4695-9cef-cd1886ff0c15 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092258 Jun 24 08:57:37.269396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 991/1846] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:37.392518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:37.393338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:37.400329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.400879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.402484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.403031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.541930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:37.549911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f6b1bf2a-38ff-48ed-8373-bcafeec97db6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161684 Jun 24 08:57:37.550500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 992/1847] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:37.555153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:37.556074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:37.563465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.563918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.564877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.565319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.597617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b15e69a8-d98d-4530-b0df-eb1b83ae704b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046078 Jun 24 08:57:37.598211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 993/1848] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:37.707315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:37.707996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:37.718961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.718961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.718961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.718961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.752386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.752918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.753457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lazy-loading 'fault' on Instance uuid e738abd4-3c88-4daf-a1a5-0ff726682731 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:57:37.796958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:37.804788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-184fced9-8afb-4a01-9351-57ac96b9ae9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 200 len: 1332 microversion: 2.1 time: 0.101731 Jun 24 08:57:37.805365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 994/1849] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:37 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:37.843542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:37.844146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:37.850375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.851087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.851864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:37.852301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:37.914661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:37.923223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7e5f2435-cde6-43f9-a1ef-3633f7df96d1 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084625 Jun 24 08:57:37.924299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 995/1850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:38.567807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:38.568468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:38.575486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.575928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.576676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.577109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.716175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:38.724047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1dcb8f4d-38c7-4b07-9f2a-b0f62d1b794c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.160143 Jun 24 08:57:38.724611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 996/1851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:38.729272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:38.730370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:38.736019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.736461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.737335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.737791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.770502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7314f62b-0ac9-473b-950a-033b3996bd1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044820 Jun 24 08:57:38.771072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 997/1852] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:38.821351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:38.821980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:38.828562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.829007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.829791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.830220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.843974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 HTTP/1.1 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 08:57:38.845606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 08:57:38.847288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': 'e738abd4-3c88-4daf-a1a5-0ff726682731'} Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 08:57:38.848163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 08:57:38.849448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 08:57:38.850642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 08:57:38.850642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1bc7551-5356-467d-bb5b-797c5e50c232 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 404 len: 111 microversion: 2.1 time: 0.029612 Jun 24 08:57:38.850642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 998/1853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:38 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 08:57:38.855812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a998c1f-080c-4eba-a13e-3241bb0395db tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '.version_select at 0x7fa68c3aa160>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:38.877820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a998c1f-080c-4eba-a13e-3241bb0395db tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422494425" status: 202 len: 0 microversion: 2.1 time: 0.025577 Jun 24 08:57:38.878382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 999/1854] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 24 08:57:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1422494425 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 08:57:38.944422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:38.945290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:38.952059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.952517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.953299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:38.953765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:38.974872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:39.024500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:39.035706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bf6c721a-1a10-4b9c-83b9-ec73409c3246 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098927 Jun 24 08:57:39.047997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1000/1855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:38 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:39.544883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3a753494-52eb-4f3d-afa1-f22b0d43e857 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: .version_select at 0x7fa68c1dd550>, body: {"keypair": {"name": "tempest-keypair-357587012", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo3ivt+03qvDd0pbLUfZMKOuVBq5AxzXMVKGPGRTWWwmYdroxYL+gl1hvwxmEY23ZOnZ0BIfj8Uyq+mEdM1ztBsoGtWL8ObpgumgLqQW3h0W/tMq7ALn7r2QpObMmmRHA=="}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:39.559787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-3a753494-52eb-4f3d-afa1-f22b0d43e857 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:57:39.563538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-3a753494-52eb-4f3d-afa1-f22b0d43e857 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:57:39.585109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3a753494-52eb-4f3d-afa1-f22b0d43e857 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044673 Jun 24 08:57:39.585796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1001/1856] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 08:57:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:39.740762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:39.741561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:39.748887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:39.749334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:39.750282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:39.750821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:39.915385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:39.923604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a4a29f8-e830-4722-b568-3815e139f77d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.187091 Jun 24 08:57:39.924174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1002/1857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:39.928831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:39.929769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:39.936052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:39.936502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:39.937271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:39.937753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:39.969399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fbe3a1fc-05c1-4434-b9ea-f609ffcf70a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Jun 24 08:57:39.970032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1003/1858] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:40.052267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:40.052932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:40.059026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:40.059414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:40.060184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:40.060620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:40.138954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:40.148575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4113df19-6447-414a-8d93-7565f9b4f098 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.099966 Jun 24 08:57:40.149235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1004/1859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:40 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:40.872719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-795723602", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ee662f5-a7df-4f34-9688-a2bb7bae451c"}], "security_groups": [{"name": "tempest-securitygroup--1589733822"}], "key_name": "tempest-keypair-357587012", "user_data": "}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:40.978860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] validate_networks() for [('0ee662f5-a7df-4f34-9688-a2bb7bae451c', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 08:57:41.627363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 08:57:41.627788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 08:57:41.628293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 08:57:41.628712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 08:57:41.629123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 08:57:41.638607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.639063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.639865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.640301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.656980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 08:57:41.661190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 08:57:41.672778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 08:57:41.675073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 08:57:41.724172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-184b2b8f-14d3-4aed-811c-f4f34a4bb8c9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.855602 Jun 24 08:57:41.729745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1005/1860] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 08:57:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 08:57:41.735132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:41.735748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:41.741875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.742328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.743105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.743546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.879996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:41.892685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f545a7e6-228d-4128-abc1-b9c7d1edaa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161275 Jun 24 08:57:41.893260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1006/1861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:41.901835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:41.901835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:41.905383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.905934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.906699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.907130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.937125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-644e8f41-a16a-4618-b551-fd57dc40dba4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042804 Jun 24 08:57:41.937694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1007/1862] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:41.942198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:41.942644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:41.948343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.948823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:41.949580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:41.950036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:42.015859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:42.023420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed92d384-0807-4d69-b1e8-4025571356da tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084756 Jun 24 08:57:42.023990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1008/1863] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:41 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:42.028793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cf8f76a1-5a05-4aa2-ac6b-90af05326851 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:42.029404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cf8f76a1-5a05-4aa2-ac6b-90af05326851 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:42.082618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cf8f76a1-5a05-4aa2-ac6b-90af05326851 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:42.089930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cf8f76a1-5a05-4aa2-ac6b-90af05326851 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1240 microversion: 2.1 time: 0.064412 Jun 24 08:57:42.090706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1009/1864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:42 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:42.910682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:42.911354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:42.918507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:42.919028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:42.919833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:42.920266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.060195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:43.068534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e8a332c7-391f-46cc-8e3c-a621d80647c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161570 Jun 24 08:57:43.069128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1010/1865] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:43.074535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:43.075492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:43.081709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.082169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.083172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.083609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.117171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4823d9e4-b902-4eac-871a-edf88a818a70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046512 Jun 24 08:57:43.117684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1011/1866] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:43.122266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:43.122875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:43.128805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.129256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.130052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.130482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.192912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:43.201083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-56f46b50-6911-4873-ab46-806d701f9700 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082382 Jun 24 08:57:43.201689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1012/1867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:43 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:43.206269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:43.206874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:43.213215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.213689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.215051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:43.215504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:43.280405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:43.288895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-14a13497-5b23-4429-9873-b8ae1b871a52 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1298 microversion: 2.1 time: 0.085980 Jun 24 08:57:43.289573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1013/1868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:43 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:43.797627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=51 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:43.820665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=77 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.090945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:44.091712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:44.098929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.099205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.100177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.100613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.244919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:44.258363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b3e8205-4089-4fd4-95c3-64ed7c3454c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.171029 Jun 24 08:57:44.270026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1014/1869] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:44.286263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:44.287230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:44.298111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.298703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.300259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.300259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.339253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a16cad16-48c1-4bdc-9aa6-01d877d7c5ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067970 Jun 24 08:57:44.341305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1015/1870] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:44.346292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:44.347020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:44.353966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.354792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.358851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.359444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.432794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:44.440731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bca957ff-ede0-494d-bd8a-a44ec8d3e5c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.098292 Jun 24 08:57:44.445810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1016/1871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:44 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:44.451028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-17fe7972-fcb5-459b-9326-6b14a5780599 req-82b6922e-f023-4b35-9fa0-eddd1564426d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da110a3-8877-41cf-b6a1-bc17120e309f", "tag": "b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:44.455115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:44.464247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-17fe7972-fcb5-459b-9326-6b14a5780599 req-82b6922e-f023-4b35-9fa0-eddd1564426d service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.465693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-17fe7972-fcb5-459b-9326-6b14a5780599 req-82b6922e-f023-4b35-9fa0-eddd1564426d service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.480807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-17fe7972-fcb5-459b-9326-6b14a5780599 req-82b6922e-f023-4b35-9fa0-eddd1564426d service nova] Creating event network-changed:b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f for instance 8da110a3-8877-41cf-b6a1-bc17120e309f on hv-cinder-78729 Jun 24 08:57:44.485920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-17fe7972-fcb5-459b-9326-6b14a5780599 req-82b6922e-f023-4b35-9fa0-eddd1564426d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038727 Jun 24 08:57:44.486553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1017/1872] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:44.491512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:44.492203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:44.498450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.498902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.499698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:44.500140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:44.634238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:44.644437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b514250e-978f-4b56-955d-7ba0d5ba8ed9 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.156636 Jun 24 08:57:44.647074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1018/1873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:44 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:45.274997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:45.275607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:45.282959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.283411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.284167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.284601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.414244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:45.422304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4976e9a6-8272-4f66-bc9f-41b4c88fcb9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151177 Jun 24 08:57:45.422868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1019/1874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:45.427425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:45.428333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:45.434021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.434469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.435263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.435701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.449539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:45.465914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60380356-7cc4-4705-8fd2-ac509bab4a54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041985 Jun 24 08:57:45.466473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1020/1875] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:45.470791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:45.471389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:45.476917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.477364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.478159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.478594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.538379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:45.545862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-beb98ca9-cd0f-44c8-987b-4b4e22d8a4d4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078417 Jun 24 08:57:45.546431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1021/1876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:45 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:45.662470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:45.663085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:45.669078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.669527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.670323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:45.670760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:45.795925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:45.803339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d610d133-b57e-4ccf-a91c-0856755a2c7a tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.144925 Jun 24 08:57:45.803901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1022/1877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:45 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:46.440253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:46.440969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:46.447380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.447826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.448589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.449021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.581410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:46.589087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2504cecd-2a6a-4075-ac4b-b7d0dfab5156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152739 Jun 24 08:57:46.591758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1023/1878] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:46.595456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:46.596372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:46.602312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.602758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.603519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.603951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.634173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3db3c4d7-b93d-4e3e-a22e-5e2720dc0c2b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042608 Jun 24 08:57:46.634731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1024/1879] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:46.639015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:46.639610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:46.645183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.645632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.646427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.646863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.706840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:46.714379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-285917ee-5fd7-4022-9f29-0965f2cfae4b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078694 Jun 24 08:57:46.714991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1025/1880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:46 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:46.820611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:46.821223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:46.827305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.827739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.828500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:46.828936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:46.955715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:46.963324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-81f71099-6745-4602-aa7b-ed59f22b6ee0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.146595 Jun 24 08:57:46.963887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1026/1881] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:46 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:47.607687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:47.608330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:47.615107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.615626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.616461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.616966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.754797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:47.762510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-24bc7ef6-8876-4885-a95a-1b64f69e1d01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.159518 Jun 24 08:57:47.763073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1027/1882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:47.767554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:47.768446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:47.774354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.774796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.775732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.776420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.806060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-da1becd7-3e92-40ff-b68e-162954cd3e9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041931 Jun 24 08:57:47.806627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1028/1883] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:47.811625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:47.812221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:47.817767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.818225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.818981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.819420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.879199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:47.886629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87a4ea29-5c26-4c06-9418-a0737278b790 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079070 Jun 24 08:57:47.887178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1029/1884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:47 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:47.980099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:47.980710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:47.987297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.987744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:47.988499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:47.988938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.124631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:48.132289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a49b04c5-aeb8-40e7-ba56-5c3f990b8b8e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.155809 Jun 24 08:57:48.132696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1030/1885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:47 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:48.780435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:48.781105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:48.787902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.788347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.789136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.789573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.932726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:48.940437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-25f253f4-fcb7-44ae-92ac-bcf5cfb6e856 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.164574 Jun 24 08:57:48.941020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1031/1886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:48.946253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:48.947181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:48.953192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.953643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.954443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.954880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.984245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4b11b00e-d08b-410b-94c2-a7125791a396 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042197 Jun 24 08:57:48.984794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1032/1887] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:48.989063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:48.989680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:48.995174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.995620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:48.996376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:48.996807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:49.058003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:49.065578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-752e923f-8f8f-497a-9450-9b118dd11c24 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079853 Jun 24 08:57:49.066178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1033/1888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:48 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:49.148934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:49.149469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:49.156749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:49.157214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:49.158026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:49.158458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:49.293767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:49.301125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33b53f74-91c2-4e1d-a48e-f0ad28ed168d tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.156069 Jun 24 08:57:49.301707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1034/1889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:49 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:49.960170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:49.961136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:49.967369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:49.967959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:49.969101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:49.969225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.109203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:50.116904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0010afb7-a613-4d0f-b323-b43988c5df6d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.161577 Jun 24 08:57:50.117478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1035/1890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:50.122284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:50.123255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:50.129187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.129637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.130428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.130864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.163436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b16f869a-a01f-4eb6-b600-1d3b23d8b99f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044686 Jun 24 08:57:50.164033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1036/1891] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:50.172008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:50.172623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:50.180840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.181463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.182290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.182746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.185614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:50.245088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:50.253100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a589facd-a1dc-4030-b13e-00041ad4fa2f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084765 Jun 24 08:57:50.253700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1037/1892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:50 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:50.317283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:50.317912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:50.323926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.324368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.325781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:50.326231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:50.460777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:50.468318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-225a726e-49ba-49fb-a199-c1f540e687ba tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.154795 Jun 24 08:57:50.468887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1038/1893] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:50 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:51.134206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:51.134866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:51.141562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.142080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.142837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.143268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.290565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:51.299051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-823fd69a-42e4-4e0b-889c-36ad4c9b1fa2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.168649 Jun 24 08:57:51.299614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1039/1894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:51.304353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:51.305276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:51.311138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.311607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.312630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.313073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.347200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01ea9b68-26ea-4c3c-bc02-059f6d376cba tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046517 Jun 24 08:57:51.347786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1040/1895] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:51.352741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:51.353354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:51.361422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.361906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.362949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.363279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.429267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:51.437127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ccc1847c-1c26-4e8a-9096-58b6eecf67bf tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087930 Jun 24 08:57:51.437727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1041/1896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:51 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:51.500428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-bd63ee08-33c8-4330-8406-2a1c98e09b43 req-37d38ff5-dcc6-4fba-b5b5-c16e3f4f5386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da110a3-8877-41cf-b6a1-bc17120e309f", "name": "network-vif-plugged", "status": "completed", "tag": "b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:51.508466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-bd63ee08-33c8-4330-8406-2a1c98e09b43 req-37d38ff5-dcc6-4fba-b5b5-c16e3f4f5386 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.508907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-bd63ee08-33c8-4330-8406-2a1c98e09b43 req-37d38ff5-dcc6-4fba-b5b5-c16e3f4f5386 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.520507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-bd63ee08-33c8-4330-8406-2a1c98e09b43 req-37d38ff5-dcc6-4fba-b5b5-c16e3f4f5386 service nova] Creating event network-vif-plugged:b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f for instance 8da110a3-8877-41cf-b6a1-bc17120e309f on hv-cinder-78729 Jun 24 08:57:51.525642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-bd63ee08-33c8-4330-8406-2a1c98e09b43 req-37d38ff5-dcc6-4fba-b5b5-c16e3f4f5386 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086787 Jun 24 08:57:51.526669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1042/1897] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 08:57:51.532364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:51.533046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:51.539178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.539627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.540377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:51.540812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:51.646922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:51.671469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:51.679025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d0f5dbf7-2a42-4c63-ba21-b6d6b57e9ac7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.151176 Jun 24 08:57:51.679590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1043/1898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:51 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:52.316029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:52.316720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:52.318598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=12 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:52.324518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.324966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.325816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.326257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.461767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:52.469549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e4b98b7e-23fb-4e2a-a16c-6c1d71d775d8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157613 Jun 24 08:57:52.470154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1044/1899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:52.474658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:52.475620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:52.481353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.482346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.483112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.483544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.512390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fb6737c2-fa02-4cda-ad8d-e5773ca98715 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041218 Jun 24 08:57:52.512942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1045/1900] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:52.517398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:52.518019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:52.524012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.524552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.525389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.526055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.588530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:52.596885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9fa7982d-0fcd-483f-8448-20a249860d15 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082953 Jun 24 08:57:52.597446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1046/1901] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:52 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:52.695032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:52.695636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:52.701628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.702104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.702849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:52.703280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:52.837022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:52.845036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e69b7376-55fb-47be-9d63-ffc9df119884 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1366 microversion: 2.1 time: 0.153845 Jun 24 08:57:52.845597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1047/1902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:52 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:53.487264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:53.487957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:53.494450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.494903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.495659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.496088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.639047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:53.646601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6fa04bc2-6662-4962-b2ea-aac3ba30d8a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.163691 Jun 24 08:57:53.647172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1048/1903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:53.651950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:53.652883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:53.658468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.658913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.659671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.660103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.689516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7dd18d8a-5a7e-4e64-939e-2da5e4e2f8b6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041347 Jun 24 08:57:53.690098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1049/1904] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:53.694351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:53.694947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:53.700405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.700832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.701580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.702041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.765227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:53.772736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f99801bc-0636-47f1-acda-5dacd8007869 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081711 Jun 24 08:57:53.773292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1050/1905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:53 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:53.864150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:53.864762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:53.870770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.871205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:53.871952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:53.872379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.000924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:54.008448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fc7fd055-fddf-4246-ac4f-8d9963c237ee tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1557 microversion: 2.1 time: 0.149462 Jun 24 08:57:54.009022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1051/1906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:53 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:54.024242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:54.024727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:54.031828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.032441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.033277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.033753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.112231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-66976c25-fb58-4cb5-998e-cadfca719acc tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091523 Jun 24 08:57:54.112838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1052/1907] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 08:57:54 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:54.664987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:54.665626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:54.671817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.672279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.673050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.673488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.881037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:54.889303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-724f91fb-ca6b-4963-819e-afb17c0b2ec2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.228314 Jun 24 08:57:54.889906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1053/1908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:54.894535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:54.895452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:54.901342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.902087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.902881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.903315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.927120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:54.933497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9246bdfc-7d86-433e-9ff4-15e8b100cf82 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042578 Jun 24 08:57:54.934108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1054/1909] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:54.939002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:54.939607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:54.945542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.946024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:54.946786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:54.947221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:55.017729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:55.025260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0e2f4ae2-eede-448f-91ed-516e02039208 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.090187 Jun 24 08:57:55.025939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1055/1910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:54 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:55.212926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-37eea174-5aba-465a-a9f2-26dc94cf1400 req-862f4294-eaf1-429d-8999-c442f59e8caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da110a3-8877-41cf-b6a1-bc17120e309f", "tag": "b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 08:57:55.221020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-37eea174-5aba-465a-a9f2-26dc94cf1400 req-862f4294-eaf1-429d-8999-c442f59e8caa service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:55.221439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-37eea174-5aba-465a-a9f2-26dc94cf1400 req-862f4294-eaf1-429d-8999-c442f59e8caa service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:55.233097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-37eea174-5aba-465a-a9f2-26dc94cf1400 req-862f4294-eaf1-429d-8999-c442f59e8caa service nova] Creating event network-changed:b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f for instance 8da110a3-8877-41cf-b6a1-bc17120e309f on hv-cinder-78729 Jun 24 08:57:55.238633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-37eea174-5aba-465a-a9f2-26dc94cf1400 req-862f4294-eaf1-429d-8999-c442f59e8caa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087394 Jun 24 08:57:55.239104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1056/1911] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 08:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 08:57:55.908773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:55.909466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:55.915852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:55.916301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:55.917058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:55.917493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:56.054091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:56.061951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0cb0240a-a3fa-4d59-b8ab-d9da3fe7890a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.158571 Jun 24 08:57:56.062532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1057/1912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:56.067185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:56.068086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:56.077470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:56.077947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:56.078719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:56.079147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:56.109391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4630731e-49c9-49f3-a6dd-1071e622c136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045794 Jun 24 08:57:56.110264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1058/1913] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:56.115235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:56.115841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:56.121964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:56.122409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:56.123208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:56.123674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:56.188205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:56.196273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ffccc107-cff9-4ed1-99cc-8e76d4cbdea7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085142 Jun 24 08:57:56.196837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1059/1914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:56 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:57.079724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:57.080350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:57.086942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.087393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.088152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.088586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.220793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:57.228789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e18441d3-e1c1-4e1f-866f-5d2e5b8334ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153115 Jun 24 08:57:57.229336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1060/1915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:57.234784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:57.235760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:57.243027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.243471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.244263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.244699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.273851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e5e9609e-25fd-4206-8b11-92dbfca0c7d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043417 Jun 24 08:57:57.274408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1061/1916] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:57.279668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:57.280265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:57.285743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.286200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.286951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:57.287384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:57.346787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:57.354097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01d238bc-8a06-4a51-b427-d5a9671e6986 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078717 Jun 24 08:57:57.354658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1062/1917] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:57 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:58.249393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:58.250072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:58.257643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.258112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.258867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.259296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.385887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:58.393375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4436d426-5439-45a3-a21a-6fd52a525a50 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148903 Jun 24 08:57:58.393977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1063/1918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:58.398500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:58.399441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:58.405397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.405900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.406664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.407105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.436465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-98903e44-0db8-4c3e-bc30-2b705543250f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041490 Jun 24 08:57:58.437011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1064/1919] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:58.441273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:58.441910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:58.447395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.447848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.448606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:58.449044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:58.516741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:58.524385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6c902823-9a24-40d7-8e85-5fb125c37cae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086434 Jun 24 08:57:58.524957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1065/1920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:58 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:57:59.410881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:59.411465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:59.418028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.418471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.419221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.419685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.547153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:59.554561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0986b8b4-87bd-4d37-b5be-37eb3881187c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147502 Jun 24 08:57:59.555117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1066/1921] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:57:59.559668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:59.561088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:59.562914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:59.568618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.569356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.570008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.570483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.603145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aa809a84-ca1c-4595-9dae-5236502d488a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047002 Jun 24 08:57:59.603700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1067/1922] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:57:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:57:59.608235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:57:59.608841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:57:59.614879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.615332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.616094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:57:59.616531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:57:59.677085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:57:59.684824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-518db9f1-22b9-4f80-8846-327f176b79dd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080190 Jun 24 08:57:59.686039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1068/1923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:57:59 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:00.572425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:00.573140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:00.580100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.580542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.581294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.581744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.713069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:00.721286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62096591-afa7-465a-bc68-d5a069167548 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152729 Jun 24 08:58:00.721880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1069/1924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:00.726506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:00.727498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:00.733160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.733600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.734375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.734801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.763336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d198a7c8-b429-4db6-a622-f20ffbf675a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040444 Jun 24 08:58:00.764393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1070/1925] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:00.768860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:00.769447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:00.775172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.775616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.776373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:00.777064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:00.839785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:00.847325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a1b66059-951d-40e1-91b9-120909b16662 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.081981 Jun 24 08:58:00.847886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1071/1926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:00 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:01.738591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:01.739204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:01.745649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.746120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:01.746869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.747296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:01.749842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:01.882091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:01.890108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d19e575f-69c2-457b-af5e-161b804bfc8f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155422 Jun 24 08:58:01.890671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1072/1927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:01.895199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:01.896433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:01.901814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.902528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:01.903286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.903720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:01.935791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9a0cf61b-cf87-488b-b704-3655bf356625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043976 Jun 24 08:58:01.936266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1073/1928] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:01.940719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:01.941318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:01.952723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.952723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:01.952723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:01.952723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:02.012547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:02.020611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4d05b1e8-b21e-49ac-9b5b-604379ccf847 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083410 Jun 24 08:58:02.021177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1074/1929] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:01 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:02.907970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:02.908638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:02.918948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:02.919394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:02.920663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:02.921108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:03.053113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:03.060627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cc58411d-814a-467a-9a5f-3d8877b12dc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.156668 Jun 24 08:58:03.061276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1075/1930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:03.065919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:03.066820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:03.072606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:03.073051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:03.073818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:03.074255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:03.102721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85faec66-983e-4767-96c6-169b34cdb980 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040410 Jun 24 08:58:03.103268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1076/1931] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:03.107492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:03.108649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:03.114122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:03.114565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:03.115307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:03.115736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:03.175867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:03.183444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a7753352-c60b-4bfc-b619-ead0460c3022 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079201 Jun 24 08:58:03.184012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1077/1932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:03 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:04.078701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:04.079403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:04.085900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.086345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.087092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.087522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.221782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:04.229653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-36e82309-41e6-41c3-87a5-1bff9985b9a5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.155653 Jun 24 08:58:04.230239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1078/1933] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:04.235274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:04.236168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:04.242029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.242473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.243223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.243651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.274197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5741414d-182a-4de9-b9d3-977a9ac759a8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042860 Jun 24 08:58:04.274756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1079/1934] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:04.279353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:04.279948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:04.285569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.286147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.286903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:04.287336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:04.346998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:04.354396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-94f2eb38-33bd-4f33-bf21-446b3ef4ff29 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078712 Jun 24 08:58:04.354953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1080/1935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:04 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:05.247313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:05.247937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:05.254954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.255404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.256163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.256596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.384495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:05.392504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b53a90c-7a98-40b8-960a-4e2bd0545a07 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149125 Jun 24 08:58:05.393268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1081/1936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:05.397551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:05.398483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:05.404295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.404741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.405522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.405980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.434038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8646410b-7701-484d-8df2-d446e2ae89cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.039950 Jun 24 08:58:05.434591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1082/1937] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:05.439374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:05.439965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:05.445449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.445925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.446672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:05.447109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:05.509715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:05.517795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bf9a1fe8-c040-4a91-9f81-74fa321aa2fa tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082261 Jun 24 08:58:05.518358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1083/1938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:05 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:06.410603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:06.411271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:06.418952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.419415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.420191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.420627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.552997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:06.560471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67d95b5c-21d8-411f-8a91-f5f75e7b5f57 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154038 Jun 24 08:58:06.561033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1084/1939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:06.565519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:06.566477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:06.572052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.572500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.573256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.573717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.602998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-94739f1a-78d8-4203-ad17-6fbc28f26498 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040943 Jun 24 08:58:06.603557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1085/1940] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:06.607919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:06.608557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:06.614621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.615067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.615826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:06.616258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:06.676456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:06.683918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d143929c-9220-4dae-9883-991ca56e9c76 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079425 Jun 24 08:58:06.684480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1086/1941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:06 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:07.578236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:07.578968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:07.585410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.585900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.586695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.587127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.717688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:07.725794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9512fa35-7972-4004-9417-eb30dd7967e5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152030 Jun 24 08:58:07.726382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1087/1942] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:07.730936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:07.731842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:07.738051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.738498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.739259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.739690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.763359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:07.768423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46c946ec-b1c7-4b3c-b1fd-ffda660bc974 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041079 Jun 24 08:58:07.768974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1088/1943] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:07.773594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:07.774218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:07.780861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.781311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.782104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:07.782539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:07.842393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:07.850349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4c2f5758-c5f6-40a3-aef0-5b7811dd3603 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080446 Jun 24 08:58:07.850913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1089/1944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:07 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:08.743437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:08.744037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:08.751241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.751692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:08.752450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.752902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:08.883677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:08.891199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-659a8e46-40dc-4849-aa75-dd2d1414bcf0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151670 Jun 24 08:58:08.891766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1090/1945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:08.896267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:08.897164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:08.903071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.903513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:08.904261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.904689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:08.933951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2c6c54ef-8367-4cc5-822c-ff221d0a7f63 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041118 Jun 24 08:58:08.934720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1091/1946] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:08.940134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:08.940995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:08.947573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.948017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:08.948780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:08.949211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:09.015858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:09.023305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f5383b7-88e3-4896-af62-c95c4dd9de23 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.087653 Jun 24 08:58:09.023875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1092/1947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:08 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:09.908686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:09.909303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:09.915795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:09.916238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:09.916990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:09.917418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:10.044685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:10.052201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-05e0c542-28e2-405f-bfe6-f6a7d969ea0e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.147457 Jun 24 08:58:10.052775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1093/1948] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:10.057313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:10.058280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:10.064427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:10.064885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:10.066049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:10.066286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:10.095498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-54a304b0-f4a6-4caf-85cd-4c1b276454d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041690 Jun 24 08:58:10.096067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1094/1949] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:10.100402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:10.101000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:10.106521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:10.106981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:10.107740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:10.108182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:10.168575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:10.176622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d2834fb-6b48-4864-9acd-1ebe1c6b32b9 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079615 Jun 24 08:58:10.177174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1095/1950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:10 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:11.069996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:11.070702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:11.077366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.078455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.079210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.079643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.210762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:11.218377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5c74c76a-5158-4c61-9116-1bde64a289a6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152270 Jun 24 08:58:11.219455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1096/1951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:11.223975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:11.224903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:11.230616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.231054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.231796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.232223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.261194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-296dfea0-d8a1-49c9-89a7-ab25aa7c610a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040713 Jun 24 08:58:11.261769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1097/1952] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:11.266662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:11.267248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:11.272720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.273167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.273941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:11.274371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:11.335612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:11.343361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-efb31895-4b8a-4e1f-ad7f-02da1062c35b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080641 Jun 24 08:58:11.343901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1098/1953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:11 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:12.237195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:12.237981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:12.244724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.245165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.245944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.246376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.376662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:12.384138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eddeff2a-796c-4cef-b27d-e6f68bcb2a3e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151850 Jun 24 08:58:12.384698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1099/1954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:12.389196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:12.390119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:12.396181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.396624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.397369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.397830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.426056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1bd6758d-e58e-4fb5-a5d0-63131ba6de24 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040341 Jun 24 08:58:12.426614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1100/1955] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:12.430813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:12.431399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:12.436741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.437182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.437958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:12.438387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:12.500831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:12.508334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7e2dece-fd6a-4fcc-a05e-a8c0544284a6 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.080813 Jun 24 08:58:12.508896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1101/1956] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:12 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:13.465237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:13.465876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:13.472035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.472479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.473230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.473676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.604900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:13.614148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7923a7f-ca62-49bb-ae6a-f2d8b9552974 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.215994 Jun 24 08:58:13.614719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1102/1957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:13.619266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:13.620265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:13.626319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.626755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.627507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.627937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.658072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ab6884f3-8cbd-40b8-bfe4-d34254de8b95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042258 Jun 24 08:58:13.658552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1103/1958] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:13.662828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:13.663422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:13.668885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.669329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.670111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:13.670540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:13.729985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:13.738269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c4668159-c4bb-4a21-9cf8-f8b4a15a634a tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078789 Jun 24 08:58:13.738824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1104/1959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:13 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:14.630901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:14.631554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:14.638019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.638464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.639222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.639743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.656186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:14.794960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:14.802855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d24aa503-3f28-4723-9318-5e17d8af3b22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.175771 Jun 24 08:58:14.803455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1105/1960] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:14.808202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:14.809740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:14.815229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.815671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.816442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.816859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.847375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bcf21680-641e-4b29-9fd1-6792101818a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042867 Jun 24 08:58:14.847931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1106/1961] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:14.852297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:14.852894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:14.858693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.859066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.859811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:14.860237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:14.923416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:14.931206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f87b6853-1393-48de-bc12-fe340b5718c2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082321 Jun 24 08:58:14.931768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1107/1962] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:14 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:15.820552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:15.821240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:15.828588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:15.829044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:15.829861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:15.830297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:15.962234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:15.969974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a8aafd69-b7e9-4614-9cfe-5b473f9cbaac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.153253 Jun 24 08:58:15.970536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1108/1963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:15.975198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:15.976101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:15.981814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:15.982260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:15.983014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:15.983447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:16.012802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-702ed6a7-148a-4093-8132-e57f68db7c69 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041255 Jun 24 08:58:16.013363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1109/1964] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:16.018337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:16.018933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:16.024522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:16.024978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:16.025762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:16.026203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:16.090202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:16.097748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cc59459c-38c6-4811-ac4a-ce7e13e258ed tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083411 Jun 24 08:58:16.098315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1110/1965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:16 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:16.986872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:16.987505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:16.996392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:16.997171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:16.998576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:16.999354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:17.133090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:17.140609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4d45d26d-b55e-4efe-abe3-c12d86261389 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157674 Jun 24 08:58:17.141172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1111/1966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:17.145777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:17.146706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:17.152496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:17.152947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:17.154001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:17.154459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:17.183483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f635b303-5024-4077-a91c-9d35b9c3a3c4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041247 Jun 24 08:58:17.184057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1112/1967] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:17.188997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:17.189590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:17.195357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:17.195808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:17.196560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:17.196992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:17.257358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:17.264778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48f432ac-4c78-4fd3-94c1-feb3aab9bbc3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079787 Jun 24 08:58:17.265346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1113/1968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:17 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:18.158379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:18.159065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:18.165528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.166007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.166770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.167204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.298702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:18.306144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9ae7247b-a662-488f-b189-a3afe29efc38 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151709 Jun 24 08:58:18.306702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1114/1969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:18.311206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:18.312124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:18.318328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.318769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.319514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.319944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.352004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ae0e58a8-d404-4c47-a8c4-b9bceb268639 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044267 Jun 24 08:58:18.352557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1115/1970] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:18.356850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:18.357440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:18.363454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.363908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.364646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:18.365070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:18.424773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:18.432353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0af8c359-33ba-4a98-9d4f-f94e62a9253b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078863 Jun 24 08:58:18.432913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1116/1971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:18 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:19.322818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:19.323510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:19.325785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:19.331059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.331504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.332254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.332685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.463849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:19.471443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8504c296-3d76-430b-9fee-2effa0a90ede tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152428 Jun 24 08:58:19.472001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1117/1972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:19.476604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:19.477509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:19.483407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.485115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.485589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.515967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18378305-78dd-4381-a7e0-13d5ff2803fb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042887 Jun 24 08:58:19.516530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1118/1973] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:19.520847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:19.521441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:19.527051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.527491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.528502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:19.528929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:19.593275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:19.601492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4a0406f4-ef5a-4707-805d-af9b21bbe7cb tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084003 Jun 24 08:58:19.602091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1119/1974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:19 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:20.493017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:20.493722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:20.500236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.500722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.501490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.501953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.633592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:20.641583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-612f641a-d520-4b3e-bb7b-74eefdd4c136 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152683 Jun 24 08:58:20.642181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1120/1975] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:20.646655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:20.647558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:20.653128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.653863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.654616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.655054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.683799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-83b5c858-c6bb-4af1-9407-df90656b8b66 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040632 Jun 24 08:58:20.684343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1121/1976] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:20.689137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:20.689759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:20.695298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.695742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.696522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:20.696951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:20.700803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:20.762778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:20.770316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-da81bb4f-4415-4b09-b6b9-4fac0d6254f7 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.085053 Jun 24 08:58:20.770875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1122/1977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:20 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:21.658827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:21.659439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:21.666155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.666605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.667357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.667790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.799537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:21.807752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5e1c0732-17e0-42eb-9177-e8a65c895092 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152754 Jun 24 08:58:21.808320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1123/1978] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:21.813430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:21.814363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:21.820361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.820804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.821574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.822028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.853054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d349890f-4862-4a25-b5c4-1cdfc82ef37a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043687 Jun 24 08:58:21.853610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1124/1979] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:21.857950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:21.858550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:21.864192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.864580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.865336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:21.865793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:21.926480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:21.933859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d3489fbd-052b-4d7b-a21b-ec8b53b292fd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079264 Jun 24 08:58:21.934420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1125/1980] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:21 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:22.825960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:22.826641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:22.833299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.833769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.834523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.834951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.962745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:22.970926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ec22f7dd-81cb-49b7-8f3e-dbde62f9c0c1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149373 Jun 24 08:58:22.971487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1126/1981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:22.976174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:22.977077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:22.982724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.983171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:22.983930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:22.984364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.012555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-98ba3b27-8496-4d75-8dc9-e38593f8fbec tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040081 Jun 24 08:58:23.013096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1127/1982] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:23.017906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:23.018501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:23.023945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.024426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.025176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.025614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.094770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:23.102274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-948a7037-d0bc-4409-9f87-27888ffd668f tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.088261 Jun 24 08:58:23.102831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1128/1983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:23 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:23.988098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:23.988801 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:23.995306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.995756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:23.996511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:23.996942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:24.126884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:24.142545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ce9da88d-1e69-49b5-b985-0b71bf9253fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157154 Jun 24 08:58:24.143942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1129/1984] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:24.148674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:24.149596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:24.156053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:24.156510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:24.157283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:24.157751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:24.186848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a70a8c8-0899-474e-90db-99c1f6456ecd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042275 Jun 24 08:58:24.187482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1130/1985] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:24.192466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:24.193069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:24.198861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:24.199317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:24.200075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:24.200511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:24.260633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:24.268956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d35269cf-8736-4679-9370-8b0030d953a4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079967 Jun 24 08:58:24.269523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1131/1986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:24 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:25.160431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:25.161127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:25.167581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.168024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.168771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.169202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.300162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:25.307614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a61bb10c-1073-4bde-8c80-f738973afa2d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151067 Jun 24 08:58:25.308172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1132/1987] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:25.312631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:25.314093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:25.319638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.320076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.320881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.321307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.350311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-73d7b53a-6ab0-436e-993b-654f20b70d1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041122 Jun 24 08:58:25.350857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1133/1988] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:25.355124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:25.355711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:25.361636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.362105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.362848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:25.363277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:25.421940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:25.429877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a1be1f70-02bb-4dc6-b2e0-dc8f6cca7a14 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078061 Jun 24 08:58:25.430438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1134/1989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:25 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:26.325291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:26.326020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:26.332948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.333388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.334195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.334623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.463621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:26.471172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-42cbbaeb-8a22-4d86-ade9-3f16ed994db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149719 Jun 24 08:58:26.471733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1135/1990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:26.476220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:26.477110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:26.482923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.483369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.484116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.484545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.512893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a763fdee-316b-412a-b1bd-ca47f7087ef5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040176 Jun 24 08:58:26.513538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1136/1991] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:26.518350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:26.518945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:26.524649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.525091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.525881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:26.526335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:26.589280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:26.599007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cc3de6aa-57cd-4396-b90e-70e7b521c033 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.084551 Jun 24 08:58:26.599575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1137/1992] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:26 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:27.488403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:27.489091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:27.495556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.496007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.496759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.497188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.858445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:27.861296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:27.868110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-75efc2e8-3ea8-4668-97f6-8c4e494db0db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.383882 Jun 24 08:58:27.868680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1138/1993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:27.873441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:27.874377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:27.879992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.880435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.881177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.881604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.911120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-94768677-a45b-4aa7-b1dd-10cc44fd25ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041323 Jun 24 08:58:27.911666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1139/1994] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:27.915943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:27.916536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:27.922114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.922557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.923901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:27.924333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:27.982794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:27.990943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12b576f7-e9f9-428d-93e9-03aaee9776a3 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078331 Jun 24 08:58:27.991500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1140/1995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:27 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:28.885401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:28.886087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:28.892445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:28.892887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:28.893637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:28.894089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:29.024921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:29.032715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-520ee454-0d46-485f-9b43-522d71fa1dcc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.151294 Jun 24 08:58:29.033269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1141/1996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:29.037781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:29.038687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:29.044591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:29.045033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:29.045810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:29.046240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:29.076075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d0d26f75-a2fd-4c56-bf0a-48364637038b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041718 Jun 24 08:58:29.076629 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1142/1997] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:29.081680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:29.082277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:29.088337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:29.088779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:29.089531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:29.089989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:29.151739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:29.160160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a797807b-6ace-4b55-8c78-fd660948748e tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082551 Jun 24 08:58:29.160730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1143/1998] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:29 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:30.050389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:30.051037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:30.057451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.057924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.058673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.059102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.196583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:30.204782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2578e944-cba7-421c-aa16-c2328983f0c2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157670 Jun 24 08:58:30.205348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1144/1999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:30.210066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:30.210980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:30.216577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.217021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.217796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.218231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.247093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7656fda-272b-4566-b650-32f896686382 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040694 Jun 24 08:58:30.247642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1145/2000] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:30.252595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:30.253194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:30.258805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.259253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.260001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:30.260435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:30.326519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:30.334602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-629d949a-95c9-4a5a-ad28-11bb56aeb1bd tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.086031 Jun 24 08:58:30.335163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1146/2001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:30 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:31.223083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:31.224033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:31.230254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.230705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.231453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.231883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.360049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:31.367470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8fc04f3a-a85a-4031-91f2-ca7e3b3455fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.149296 Jun 24 08:58:31.368032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1147/2002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:31.372492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:31.373383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:31.378953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.379396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.380139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.380567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.409530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-59896d2b-2030-46cf-8f4d-14234d0e3e74 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040524 Jun 24 08:58:31.410096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1148/2003] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:31.414321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:31.414908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:31.420307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.420749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.421491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:31.421962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:31.480818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:31.488334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a1210d78-2e39-4cef-bc45-47d9fe2c7142 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.077320 Jun 24 08:58:31.488899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1149/2004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:32.384600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:32.385275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:32.391752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.392197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.392942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.393373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.522840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:32.530808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-876419fa-d537-44e7-8928-1b4e9e9b96ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.150131 Jun 24 08:58:32.531369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1150/2005] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:32.537523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:32.538520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:32.544388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.544837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.545586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.546056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.574784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b4a4a939-62bc-4f16-9d1d-7125174beff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041083 Jun 24 08:58:32.575333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1151/2006] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:32.579788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:32.580387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:32.585844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.586293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.587039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:32.587473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:32.650676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:32.659023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-93e15e8d-1a2c-48e4-9d86-114fc1057cce tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082761 Jun 24 08:58:32.659597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1152/2007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:33.549116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:33.549823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:33.556343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.556797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.557579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.558037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.685453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:33.693533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-170dd13c-d739-4c2c-8550-eace06bd3eae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.148910 Jun 24 08:58:33.694125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1153/2008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 08:58:33.698628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:33.699558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:33.705209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.705690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.706455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.706893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.737037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9ba70280-6ce7-493f-a711-71a37ef7f2dc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041884 Jun 24 08:58:33.737590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1154/2009] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 08:58:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 08:58:33.741931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:33.742532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:33.748521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.748974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.749774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.750216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.764713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:33.814139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 08:58:33.821530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-20d665b8-a152-4051-9cab-707c00a254ae tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082985 Jun 24 08:58:33.822126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1155/2010] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 08:58:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 08:58:33.853182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 08:58:33.853688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 08:58:33.859685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.860131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:33.861566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 08:58:33.862031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 08:58:43.857108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=79 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:43.880137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=7 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:08.112677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:59:08.113290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:59:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 08:59:31.335065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:59:33.835405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 08:59:33.836200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 08:59:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 08:59:35.641577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 08:59:41.340267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:45.645419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:00:31.209302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:31.210119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:00:43.073559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:43.074203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:00:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:00:43.724307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:43.724882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:00:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:00:51.158034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:00:51.158701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:01:31.434213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:01:31.436515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:01:31.438308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:01:31.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:01:31.440355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:31.441572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:01:31.443859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) Jun 24 09:01:31.445834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:01:31.447186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bdb8ae0f-05ba-4a8f-971a-cc24064b8891) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:01:31.447186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bde042aa-fb8b-456f-91a5-9f5895e33c7f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 237.649121 Jun 24 09:01:31.447186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 856/2011] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 08:57:33 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 237650 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:01:31.447186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:31.447561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:31.452532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.452834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.453635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.454087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.587817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:01:31.597195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5c16e87a-8b27-48bc-b4e3-4bee5a9398ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.157037 Jun 24 09:01:31.597777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 857/2012] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:01:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:01:31.718716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:31.719788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:31.726462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.726989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.727760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.728200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.756940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0722168-ef1b-4aff-8fbe-fa889a2c85d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158163 Jun 24 09:01:31.757503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 858/2013] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:01:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:01:31.761798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:31.762402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:31.767817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.768269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.769032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.769468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.831001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:01:31.840612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4ac25941-5eef-4992-bc03-627b22bab914 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.082092 Jun 24 09:01:31.841192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 859/2014] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:01:31 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:01:31.845697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:31.846193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:31.852629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.853077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.853884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.854326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.877587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-362a27bb-64c6-4155-8686-5da0f6967b93 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.035235 Jun 24 09:01:31.878120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 860/2015] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:01:31 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:01:31.882698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:31.883190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:31.889052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.889515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:31.890318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:31.890758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:35.992505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:01:35.994920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:01:35.996570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:01:35.997908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:01:35.999800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:36.002069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:01:36.003663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) Jun 24 09:01:36.004990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:01:36.006366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-867ee08a-b311-4223-b73e-31d3375649c6) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:01:36.006366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba12446c-8660-4ae6-850f-2ca03f339112 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 182.147177 Jun 24 09:01:36.006366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1156/2016] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 08:58:33 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 182148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 09:01:36.006366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.006735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.009912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.010371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.011141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.011586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.144826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:01:36.152405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bddf0cde-f03f-4a05-9314-a5ad8a5d171d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.154102 Jun 24 09:01:36.152913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1157/2017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:01:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:01:36.157564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.158556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.164930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.165376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.166179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.166601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.199993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9a96f729-553b-4f30-b76f-20c2fac50b9b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045864 Jun 24 09:01:36.200550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1158/2018] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:01:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:01:36.205023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.205623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.211132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.211581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.212337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.212771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.272470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:01:36.280653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8be709f6-c20d-4158-a5f7-6642643ffe0c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.079007 Jun 24 09:01:36.281255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1159/2019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:01:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:01:36.285795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.286284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.292650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.293102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.293893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.294329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.318435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:01:36.393617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5329d6c6-c93b-462c-ac06-070f0175a723 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.110528 Jun 24 09:01:36.394304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1160/2020] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:01:36 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:01:36.403247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.403785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.410228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.410652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.411424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.412129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.438305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-21f05841-ec58-4752-a554-70d17851f477 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.042652 Jun 24 09:01:36.438885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1161/2021] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:01:36 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:01:36.443357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:01:36.443847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:01:36.449504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.449990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:36.450743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:01:36.451218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:01:41.886488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=10 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:41.909562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=26 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:46.447523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:46.470978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:28.122166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:02:28.122889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:02:53.844750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:02:53.845481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:03:31.651744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:03:36.109998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:03:41.656041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:46.114252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:03:51.217205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:03:51.218029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:04:03.081815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:04:03.082371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:04:03.733127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:04:03.733721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:04:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:04:11.166974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:04:11.167756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:05:31.864737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:05:31.867446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:05:31.869064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:05:31.870182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:05:31.871312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:31.872512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:05:31.873551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) Jun 24 09:05:31.874732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3e9a5fd4-b9d6-4e34-a716-607a525f35e6) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 239.990309 Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:05:31 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (10.222.0.48) Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: CRITICAL nova [None req-e4e44e96-cfe2-4d25-9d79-93f826dd30c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Unhandled error: OSError: write error Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova OSError: write error Jun 24 09:05:31.875867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova Jun 24 09:05:31.876398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 861/2022] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:01:31 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 0 bytes in 239992 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:05:31.987319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:31.988079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:31.994822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:31.995377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:31.996198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:31.996694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.132571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:05:32.140070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f06cf330-11cb-4cd8-a926-bc2da0fd43fb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.268534 Jun 24 09:05:32.140629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 862/2023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:05:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:05:32.145646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:32.146623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:32.152198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.152645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.153413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.153885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.182714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4e30df60-2b6b-49de-b1fa-09b79b45154d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041079 Jun 24 09:05:32.183273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 863/2024] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:05:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:05:32.187554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:32.188170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:32.193482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.193971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.194730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.195177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.258653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:05:32.267955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-185c714d-0093-4186-99e2-03060b9d6fd8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.083740 Jun 24 09:05:32.268520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 864/2025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:05:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:05:32.385523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:32.386056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:32.392879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.393650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.394974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.395508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.422221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:05:32.468577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.compute.api [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:05:32.469394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b2b2e71-4b7e-4029-8e5e-5f2cdf0eb85c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.199963 Jun 24 09:05:32.470055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 865/2026] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:05:32 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:05:32.570618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:32.571164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:32.577105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.577551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.578368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.578805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.601426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ffa4c6cf-72c3-4220-8c66-646a37dfa29c tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.130422 Jun 24 09:05:32.601997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 866/2027] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:05:32 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:05:32.606340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:32.606797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:32.612900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.613343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:32.614130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:32.614564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.250079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:05:36.252970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:05:36.254602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:05:36.255741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:05:36.257087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:36.258484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:05:36.259738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) Jun 24 09:05:36.261083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-00c2a78a-7e87-4c25-9ea8-687d3e921191) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 239.814836 Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:05:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:05:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (10.222.0.48) Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: CRITICAL nova [None req-642b445b-0cf4-4442-9b21-02157bdab9ca tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Unhandled error: OSError: write error Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova OSError: write error Jun 24 09:05:36.262690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova Jun 24 09:05:36.263276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1162/2028] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:01:36 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 0 bytes in 239817 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:05:36.263276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.263276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.269044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.269498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.270362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.270803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.401707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:05:36.409055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79ac5beb-b412-453c-9a3e-ef35b8724bc2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.152067 Jun 24 09:05:36.409611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1163/2029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:05:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:05:36.414508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.415413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.421096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.421546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.422345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.423280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.454170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a81388a7-de16-438b-ac82-1e4647085b3a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Jun 24 09:05:36.454736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1164/2030] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:05:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:05:36.458993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.459590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.464893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.465343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.466130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.466568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.525634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:05:36.533778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-019b8b96-6394-4e54-82c2-099fcda2b1e0 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078078 Jun 24 09:05:36.534337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1165/2031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:05:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:05:36.538867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.539343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.544740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.545180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.545959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.546388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.571708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:05:36.618864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.compute.api [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:05:36.619686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-acbca679-ead3-4f12-a482-508976ee3a70 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.084440 Jun 24 09:05:36.620229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1166/2032] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:05:36 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:05:36.624603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.625075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.631030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.631471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.632213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.632643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.654287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ad67ff7d-d31a-4b1f-8767-f2f476df33b7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.033047 Jun 24 09:05:36.654778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1167/2033] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:05:36 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:05:36.659701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:05:36.660176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:05:36.665738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.666183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:36.666917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:05:36.667343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:05:42.609706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=12 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:42.632443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:46.664212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=12 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:46.684609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:48.129885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:05:48.130483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:05:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:06:13.852579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:06:13.853351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:11.225747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:07:11.226313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:23.089695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:07:23.090287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:23.741154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:07:23.741755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:31.175908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:07:31.176544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:32.234958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:07:36.410453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:07:36.479163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:07:36.481336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.482862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.483851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.487094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.488652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.490383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) Jun 24 09:07:36.492105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-63dd8a26-0277-4041-9b20-b39b7b3754dd) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 123.879863 Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (10.222.0.48) Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: CRITICAL nova [None req-07ea36f0-0747-4f42-b52a-1140414cec1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Unhandled error: OSError: write error Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova OSError: write error Jun 24 09:07:36.493456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova Jun 24 09:07:36.494470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 867/2034] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:05:32 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 0 bytes in 123881 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:07:36.494470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.494470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.496949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.497389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.498187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.498618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.554478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:07:36.556640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.558107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.558761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.560152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.562230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.564202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) Jun 24 09:07:36.565599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a676241a-b08d-4dab-baa6-c762de7d3b1a) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 119.902488 Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (10.222.0.48) Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: CRITICAL nova [None req-f40c7907-0a51-4487-8ec2-c733b2645e0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Unhandled error: OSError: write error Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova OSError: write error Jun 24 09:07:36.567060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova Jun 24 09:07:36.567644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1168/2035] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:05:36 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 0 bytes in 119904 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:07:36.642826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:36.651714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.166273 Jun 24 09:07:36.652251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c (ip 10.222.0.48) !!! Jun 24 09:07:36.652251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c (10.222.0.48) Jun 24 09:07:36.652843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: CRITICAL nova [None req-4c87938a-9993-4015-a642-de389d43f3b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Unhandled error: OSError: write error Jun 24 09:07:36.652843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova OSError: write error Jun 24 09:07:36.652843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova Jun 24 09:07:36.653109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 868/2036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 0 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:07:36.658338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.659127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.665536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.666162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.666968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.667582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.693447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.694524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.702684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.703405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.705874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.706916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.740452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:36.744567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.184145 Jun 24 09:07:36.745135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments (ip 10.222.0.48) !!! Jun 24 09:07:36.745135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:07:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments (10.222.0.48) Jun 24 09:07:36.745744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: CRITICAL nova [None req-ca6de274-c691-403d-8d23-f1f6e14bd995 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Unhandled error: OSError: write error Jun 24 09:07:36.745744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova OSError: write error Jun 24 09:07:36.745744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova Jun 24 09:07:36.745998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1169/2037] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 0 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:07:36.748883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.094954 Jun 24 09:07:36.749399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 (ip 10.222.0.48) !!! Jun 24 09:07:36.749583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:07:36 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 (10.222.0.48) Jun 24 09:07:36.750336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: CRITICAL nova [None req-d0fc4266-601c-4c95-9cd7-b596f70a6383 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Unhandled error: OSError: write error Jun 24 09:07:36.750336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova OSError: write error Jun 24 09:07:36.750336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova Jun 24 09:07:36.750736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.750883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 869/2038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jun 24 09:07:36.751234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.755379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.755870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.761692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.762152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.762928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.763357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.765753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.766272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.767582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.768017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.786737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a42ac5d4-ab08-4aaa-8b2c-c2eb0d9a66d0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.034988 Jun 24 09:07:36.787307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 870/2039] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:07:36.792097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.792582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.794837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:07:36.799004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.799453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.800214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.800647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.846227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.compute.api [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:07:36.847039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0b722132-f387-4f9d-9eb3-4d97d375edee tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.100295 Jun 24 09:07:36.847595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1170/2040] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:07:36 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:07:36.852104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:36.852700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:36.858342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.858787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.860101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:36.860530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:36.880917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:07:36.986682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:07:36.989227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:07:36.990691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.991357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:07:36.992726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.993940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.995032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) Jun 24 09:07:36.996164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:07:36.997257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ae3d556f-84fb-42b4-b37d-2b3c40983b27) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:07:36.997257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7f5f5c9d-e54f-4b3f-96df-975956190437 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 0.202734 Jun 24 09:07:36.997257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 871/2041] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:07:36 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:07:36.997257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.000321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.007062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.007542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.008442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.009152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.011694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:37.019344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac2f57ba-c0f0-4f66-979f-53600dcac2b3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.170764 Jun 24 09:07:37.020058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1171/2042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:07:37.026887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.027825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.037792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.038735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.039756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.040414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.048018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a3719ad2-a22d-4c66-8284-e0927c351326 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055419 Jun 24 09:07:37.048607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 872/2043] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:07:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:07:37.054605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.055182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.061914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.062417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.063188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.063622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.088036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:07:37.129966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:37.136499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.compute.api [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:07:37.138131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5ef08cce-33e9-4138-8bbb-1f439b69f49c tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.088155 Jun 24 09:07:37.138760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-74f3a897-a888-4286-8d62-89e571208ee2 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.117648 Jun 24 09:07:37.139174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 873/2044] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:07:37 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:07:37.139479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1172/2045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:07:37.145268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.145788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.146484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.147106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.151879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.152328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.153014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.153147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.153463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.153583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.154279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.154775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.179209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb746f4a-1685-4fab-9aaf-3e64a1bb2e61 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.038597 Jun 24 09:07:37.179772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 874/2046] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:07:37.184039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.184638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.190274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.190715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.191463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.191895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.317468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:37.325331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-05b8f332-4fac-4d84-9c41-85b62f865b7b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.144628 Jun 24 09:07:37.325916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 875/2047] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:07:37.330911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.331799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.337190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.337623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.338460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.338839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.367712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-138a885e-ccb9-4589-b748-b25360671d07 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040768 Jun 24 09:07:37.368251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 876/2048] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:07:37.372453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.373052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.378415 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.378863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.379622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.380061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.440610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:07:37.448144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eae0f850-f9ef-4126-9e35-59cf0835c626 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1225 microversion: 2.1 time: 0.078967 Jun 24 09:07:37.448704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 877/2049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:07:37.453773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.454265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.459693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.460150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.460932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.461356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.486192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:07:37.537722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.compute.api [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:07:37.538835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-89183d29-d56d-4d79-b918-b64605ad83c2 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.089093 Jun 24 09:07:37.539682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 878/2050] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:07:37 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:07:37.544048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.544540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.550725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.551175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.551961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.552420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.576769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-506f3585-2828-450c-a17f-6ed03f9c931b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.036267 Jun 24 09:07:37.577381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 879/2051] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:07:37 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:07:37.582573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:07:37.583059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:07:37.589053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.589434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:37.590230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:07:37.590667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:07:47.149848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=10 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:47.172839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:47.586999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=26 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:47.609169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:08.137443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:09:08.138144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:09:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 (ip 10.222.0.48) !!! Jun 24 09:09:32.383763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:32.429619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:32.584606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:32.586861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.588651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.589880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.593051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.594485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) Jun 24 09:09:32.595915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.597365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-45eac5c5-eff1-446a-ba2c-52da0d79cc55) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:32.597365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-78cce09c-9902-40b3-b02e-9b9fbea765b5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 115.447783 Jun 24 09:09:32.597365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1173/2052] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:07:37 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 115449 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:09:32.597365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.597869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.600526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.600961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.601725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.602152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.630833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:09:32.632977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.634580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.635499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.636623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.637849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.638937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) Jun 24 09:09:32.640083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.641166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bc5550c2-0506-4de3-9a6c-22fa7962d961) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:32.641166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-102cd017-e2ec-41c4-8903-e2ce154e7778 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 115.056203 Jun 24 09:09:32.641166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 880/2053] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:07:37 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 115058 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:09:32.643183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.644387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.650602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.651050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.652045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.652661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.683360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a6b3b877-2c4e-40a1-9b59-a2899df63b37 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046436 Jun 24 09:09:32.683918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 881/2054] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:09:32.688506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.689711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.695417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.695870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.696640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.697082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.729313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.729794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.730249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lazy-loading 'fault' on Instance uuid 9ddcaa83-a766-4122-8923-3bb23b844391 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:32.739028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:32.746636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dc169c7f-0cd7-4805-b72b-2dbde2f346ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.156648 Jun 24 09:09:32.748275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1174/2055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:32.753488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.754331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.760614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.761445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.762235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.762663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.777015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:32.786563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-14467520-2888-4da8-a002-d39f1cebcb79 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1230 microversion: 2.1 time: 0.101494 Jun 24 09:09:32.787434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 882/2056] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:32.791214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:09:32.792398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.793540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.800185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.800631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.801389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.801847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.825992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-295f5e3d-dbe5-4e3a-ae89-7fb000a62767 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.037346 Jun 24 09:09:32.826816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 883/2057] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:32.831897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.832407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.838246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.838693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.839453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.839882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.866357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6669d348-c67f-4796-b650-46c926c95c6a tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.116672 Jun 24 09:09:32.867278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1175/2058] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:32 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:09:32.871918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.872499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.878309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.878760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.879521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.879950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.921608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:32.978387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:09:32.980562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:32.981984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.982694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:32.983777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.984967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.986625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) Jun 24 09:09:32.987836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:32.989252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-616ea404-b1be-4ceb-b333-0c1e1230f9d5) {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:32.989252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-17a170ae-a323-4a72-a462-12b9252fc1d2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 0.154223 Jun 24 09:09:32.989252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 884/2059] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:09:32 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:09:32.989252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:32.989591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:32.995204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.995800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:32.996703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:32.997211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.021066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:33.028870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-91027da5-0ade-4195-bd91-f65649616350 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045227 Jun 24 09:09:33.029037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9578afbf-8434-439f-bbaf-b678557a60f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.160843 Jun 24 09:09:33.029496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1176/2060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:33.029966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 885/2061] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:09:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:09:33.036186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.036798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.041346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.042228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.045106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.045554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.046412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.046845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.050287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.050799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.051585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.052466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.079136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:09:33.091884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.092681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.093296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lazy-loading 'fault' on Instance uuid 9ddcaa83-a766-4122-8923-3bb23b844391 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:33.128500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.compute.api [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Instance is already in deleting state, ignoring this request Jun 24 09:09:33.129550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a36f10a5-4842-41c3-a12d-4bff304724ab tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 204 len: 0 microversion: 2.1 time: 0.098502 Jun 24 09:09:33.130240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 886/2062] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:33 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:09:33.135551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.136267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.139405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a25c8981df44bb285f37ef333c90f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd57cef0777f4a34a27bf60518a801da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:33.143376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.143831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.144639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.145083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.146312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33d4b9e7-8b72-4983-968e-6c9b40d14d6c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 200 len: 1184 microversion: 2.1 time: 0.114861 Jun 24 09:09:33.146888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1177/2063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 1184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:33.151513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.151939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.158278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.158728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.159486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.159920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.169800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1bb31e7c-f57b-498e-81a5-dd8922926315 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.038129 Jun 24 09:09:33.170688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 887/2064] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:33.175472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.176082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.183233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.183692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.184470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.184913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.244740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'services' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:09:33.310922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 HTTP/1.1 Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:33.313286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:09:33.315003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'server_id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34', 'id': 'eeee1da9-03b7-4c33-8cb4-9c94209e5305'} Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:33.315817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:33.317164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.319501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.321937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) Jun 24 09:09:33.324866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.326859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fe9c8574-74ab-44dc-9ed5-518385723ee7) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.326859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c6b330e2-c061-44f9-8071-9de366bdb16e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305" status: 400 len: 269 microversion: 2.1 time: 0.167009 Jun 24 09:09:33.326859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1178/2065] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:09:33 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34/os-volume_attachments/eeee1da9-03b7-4c33-8cb4-9c94209e5305 => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:09:33.326859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.327698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.330275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.330797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.331464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.331944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.332119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:33.343168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-be97ffbd-b412-48b8-b833-548937cf22a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.171056 Jun 24 09:09:33.344131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 888/2066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:33.349124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.349860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.355656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.356247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.357014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.357444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.363973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cdeafb4b-87d7-4ee8-aa20-88b4fb822850 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047196 Jun 24 09:09:33.364615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1179/2067] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:09:33.369149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.369797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.371092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] HTTP exception thrown: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Request method failure captured: Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 HTTP/1.1 Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXpdq73Q1L7g3xm0ihGMR9RWm-wrq5hW-BbeortenUKyaj0v5v_1W-iuBWxH_WaUq3RBU29HXnwchqnpFMxP52wp_WqBNqdVrng4LwBOsHyhMprCjfZwUxIlFbKBMqHy3smABgN5f772XkqQaF-wirlZTFoqk4X7zZS4YJSGl5lwm_A Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:09:33.372625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 8a25c8981df44bb285f37ef333c90f8a Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.374077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '9ddcaa83-a766-4122-8923-3bb23b844391'} Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.374957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.376994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.378194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Returning 404 to user: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.378194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3b188d92-6776-40fe-a2ba-d0089bfc8fa4 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 404 len: 111 microversion: 2.1 time: 0.029194 Jun 24 09:09:33.378194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 889/2068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:33.379662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.380353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.380967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.381960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.397562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f HTTP/1.1 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:33.399163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.400854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '4082e89e-1b7b-4b79-a6aa-73dd4baafb6f'} Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.401898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.403522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.405061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 404 to user: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.405061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-45e05c13-cabd-45e8-aee6-de4fd5642ad5 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 404 len: 111 microversion: 2.1 time: 0.035005 Jun 24 09:09:33.405061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1180/2069] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:33 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:33.405464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.405997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.412748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.413201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.413989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.414419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.438206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12319283-c50c-456b-9d77-4e50701c7bdd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.036126 Jun 24 09:09:33.438815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1181/2070] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:33.443193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.443792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.449523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.450008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.450787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.451201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.542281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4082e89e-1b7b-4b79-a6aa-73dd4baafb6f", "name": "network-vif-deleted", "tag": "3926db83-00b6-4e73-a40a-6bae494be87c"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:09:33.550476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.551195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.566187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] Creating event network-vif-deleted:3926db83-00b6-4e73-a40a-6bae494be87c for instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f on hv-cinder-78729 Jun 24 09:09:33.576326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR oslo.messaging._drivers.impl_rabbit [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] [14809082-b7ee-4e7a-aba5-868e548b8280] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 09:09:33.604884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:33.617331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c19b0794-b1ed-4640-9ccf-976d4e3b0e83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1562 microversion: 2.1 time: 0.177504 Jun 24 09:09:33.617928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1182/2071] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:33.622577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.623658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.630094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.630630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.631410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.631953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.662307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b2f89abe-454e-483d-85bd-43370083e6f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042819 Jun 24 09:09:33.662779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1183/2072] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:09:33.667050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.667641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.673194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.673642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.674418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.674851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.689363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] HTTP exception thrown: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Request method failure captured: Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 HTTP/1.1 Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXpdq73Q1L7g3xm0ihGMR9RWm-wrq5hW-BbeortenUKyaj0v5v_1W-iuBWxH_WaUq3RBU29HXnwchqnpFMxP52wp_WqBNqdVrng4LwBOsHyhMprCjfZwUxIlFbKBMqHy3smABgN5f772XkqQaF-wirlZTFoqk4X7zZS4YJSGl5lwm_A Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:33.690932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 8a25c8981df44bb285f37ef333c90f8a Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.692354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '9ddcaa83-a766-4122-8923-3bb23b844391'} Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.693129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:33.694424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.695566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Returning 404 to user: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.695566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79e78c29-39ce-45c9-a970-08a19637117b tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 404 len: 111 microversion: 2.1 time: 0.028641 Jun 24 09:09:33.695566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1184/2073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:33.697350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.697756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.703868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.705072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.707628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.708268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.733129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f HTTP/1.1 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:33.734773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.736174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '4082e89e-1b7b-4b79-a6aa-73dd4baafb6f'} Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.736973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.739290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.742034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 404 to user: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.742034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-01cb2659-b9ea-4e11-8b88-3477f8d5a695 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 404 len: 111 microversion: 2.1 time: 0.047892 Jun 24 09:09:33.742346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1185/2074] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:33 2022] DELETE /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:33.747914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.748401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.763296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.763731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.764670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.765994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.793311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ff228c97-d366-4ee6-bfac-b25057d620eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips" status: 200 len: 151 microversion: 2.1 time: 0.049958 Jun 24 09:09:33.794533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1186/2075] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:33.799452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:33.800048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:33.807930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.808374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.809125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:33.809754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:33.826897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f HTTP/1.1 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:33.828850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.830848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '4082e89e-1b7b-4b79-a6aa-73dd4baafb6f'} Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:33.831619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. Jun 24 09:09:33.832877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:33.835472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 404 to user: Instance 4082e89e-1b7b-4b79-a6aa-73dd4baafb6f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:33.836524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d82c801e-2277-435e-ad40-a01585a27827 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f" status: 404 len: 111 microversion: 2.1 time: 0.041086 Jun 24 09:09:33.837503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1187/2076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:33 2022] GET /compute/v2.1/servers/4082e89e-1b7b-4b79-a6aa-73dd4baafb6f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:33.842175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-320289864", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763813610", "security_groups": [{"name": "tempest-secgroup-smoke-31330578"}], "block_device_mapping_v2": [{"uuid": "24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cd6db2d-add9-420a-b2b7-857a38cb2a1c"}]}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:09:34.209368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] validate_networks() for [('9cd6db2d-add9-420a-b2b7-857a38cb2a1c', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:09:34.584135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] [14809082-b7ee-4e7a-aba5-868e548b8280] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 56856. Jun 24 09:09:34.588470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-6ebc9e83-8198-4221-a633-f975a8986941 req-1449aff9-8039-4410-8a99-048ae52036b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.212267 Jun 24 09:09:34.589585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 890/2077] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:34.594941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98bd4cc5-ef5b-4032-8a01-3c0c890db557 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '.version_select at 0x7fa687797280>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:34.619448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98bd4cc5-ef5b-4032-8a01-3c0c890db557 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220660037" status: 202 len: 0 microversion: 2.1 time: 0.028517 Jun 24 09:09:34.620315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 891/2078] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 24 09:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220660037 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:09:34.674675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:09:34.676161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:34.685651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.686488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.687542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.688043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.790380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d25398b1-388d-48e8-84f7-105c6b3fafb9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action" status: 200 len: 37858 microversion: 2.20 time: 0.119985 Jun 24 09:09:34.791215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 892/2079] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 24 09:09:34 2022] POST /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e/action => generated 37858 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:09:34.804839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:34.805432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:34.820940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.821406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.825359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.825927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.894504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:09:34.925311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:09:34.925872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:09:34.926823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:09:34.927337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:09:34.928123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:09:34.938519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.939108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.940120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:34.940669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:34.961562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for project dd57cef0777f4a34a27bf60518a801da. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:09:34.968217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Getting quotas for user 8a25c8981df44bb285f37ef333c90f8a and project dd57cef0777f4a34a27bf60518a801da. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:09:35.057039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6011080c-48ba-4424-8efa-c69de0a10fa5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 204 len: 0 microversion: 2.1 time: 0.255705 Jun 24 09:09:35.059992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 893/2080] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:34 2022] DELETE /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:09:35.066163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:09:35.068512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 16787bcf-9a09-40f4-acbf-93bd1e978cde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf',volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:09:35.144608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-1e09ddd6-b074-4b42-9792-da77b96d6520 req-2c09750b-66c1-4f4f-8ad2-6e6205b5616c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:09:35.155413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-1e09ddd6-b074-4b42-9792-da77b96d6520 req-2c09750b-66c1-4f4f-8ad2-6e6205b5616c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:35.158332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Request method failure captured: Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 474 Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXpdq73Q1L7g3xm0ihGMR9RWm-wrq5hW-BbeortenUKyaj0v5v_1W-iuBWxH_WaUq3RBU29HXnwchqnpFMxP52wp_WqBNqdVrng4LwBOsHyhMprCjfZwUxIlFbKBMqHy3smABgN5f772XkqQaF-wirlZTFoqk4X7zZS4YJSGl5lwm_A Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:09:35.161998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 8a25c8981df44bb285f37ef333c90f8a Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:35.163964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {"server": {"name": "tempest-TestVolumeBootPattern-server-320289864", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-763813610", "security_groups": [{"name": "tempest-secgroup-smoke-31330578"}], "block_device_mapping_v2": [{"uuid": "24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9cd6db2d-add9-420a-b2b7-857a38cb2a1c"}]}} Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-320289864', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-763813610', 'security_groups': [{'name': 'tempest-secgroup-smoke-31330578'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf'}], 'networks': [{'uuid': '9cd6db2d-add9-420a-b2b7-857a38cb2a1c'}]}}} Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:35.165046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise self.value Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:35.165932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:09:35.172493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise self.value Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jun 24 09:09:35.174034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:09:35.175546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise self.value Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._validate_bdm( Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:35.178684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:35.180089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:35.181621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) Jun 24 09:09:35.181621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:09:35.181621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 24b446b2-b6c6-40c9-8d5f-ce13f0f2a7cf status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-ec94f931-fb41-4f4c-a00f-550859d90d07) {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:35.181621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f8280e25-518e-4f63-a1f7-493e9545bb33 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.327523 Jun 24 09:09:35.181621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1188/2081] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:09:33 2022] POST /compute/v2.1/servers => generated 295 bytes in 1329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:09:35.184679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-1e09ddd6-b074-4b42-9792-da77b96d6520 req-2c09750b-66c1-4f4f-8ad2-6e6205b5616c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:35.184783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:35.184783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:35.194279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-1e09ddd6-b074-4b42-9792-da77b96d6520 req-2c09750b-66c1-4f4f-8ad2-6e6205b5616c service nova] Creating event network-changed:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 09:09:35.195785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:35.196243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:35.197007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:35.197440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:35.207466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-1e09ddd6-b074-4b42-9792-da77b96d6520 req-2c09750b-66c1-4f4f-8ad2-6e6205b5616c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145827 Jun 24 09:09:35.208291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 894/2082] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:35.428474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:35.441915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e1943d41-5620-4b53-99d2-e1b8dcb4b690 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.273786 Jun 24 09:09:35.443229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1189/2083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:36.464531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:36.465117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:36.465251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:36.465759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:36.472531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.473519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.473648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.474007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.474444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.474760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.474904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.475481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.488999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] HTTP exception thrown: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Request method failure captured: Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 HTTP/1.1 Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXpdq73Q1L7g3xm0ihGMR9RWm-wrq5hW-BbeortenUKyaj0v5v_1W-iuBWxH_WaUq3RBU29HXnwchqnpFMxP52wp_WqBNqdVrng4LwBOsHyhMprCjfZwUxIlFbKBMqHy3smABgN5f772XkqQaF-wirlZTFoqk4X7zZS4YJSGl5lwm_A Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:09:36.490821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 8a25c8981df44bb285f37ef333c90f8a Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.492224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '9ddcaa83-a766-4122-8923-3bb23b844391'} Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:36.493047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.497576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.499099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Returning 404 to user: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:36.499099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5759228b-4803-476d-8398-ba23d25dfc43 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 404 len: 111 microversion: 2.1 time: 0.033598 Jun 24 09:09:36.499099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 895/2084] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:09:36 2022] DELETE /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:36.501093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:36.502263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] [instance: 9ddcaa83-a766-4122-8923-3bb23b844391] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:36.508325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.508747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.509843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.509972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.528656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] HTTP exception thrown: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Request method failure captured: Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 HTTP/1.1 Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXpdq73Q1L7g3xm0ihGMR9RWm-wrq5hW-BbeortenUKyaj0v5v_1W-iuBWxH_WaUq3RBU29HXnwchqnpFMxP52wp_WqBNqdVrng4LwBOsHyhMprCjfZwUxIlFbKBMqHy3smABgN5f772XkqQaF-wirlZTFoqk4X7zZS4YJSGl5lwm_A Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:09:36.530241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dd57cef0777f4a34a27bf60518a801da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: dd57cef0777f4a34a27bf60518a801da Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestVolumeBootPattern-748779858 Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 8a25c8981df44bb285f37ef333c90f8a Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestVolumeBootPattern-748779858-project Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.531891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '9ddcaa83-a766-4122-8923-3bb23b844391'} Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:09:36.535849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. Jun 24 09:09:36.537645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:09:36.539722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Returning 404 to user: Instance 9ddcaa83-a766-4122-8923-3bb23b844391 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:09:36.539722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-26e247e9-f38e-4114-9ccb-56c4c52264d8 tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391" status: 404 len: 111 microversion: 2.1 time: 0.034158 Jun 24 09:09:36.539722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 896/2085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:36 2022] GET /compute/v2.1/servers/9ddcaa83-a766-4122-8923-3bb23b844391 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:09:36.637353 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:36.657969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53bffa4b-d633-4035-a1aa-cbbc938bacf4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1568 microversion: 2.1 time: 0.198737 Jun 24 09:09:36.658788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1190/2086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:36.697957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-937ff2e6-7016-4a42-a3aa-a130ac813ec3 req-dbf15768-7a9d-4638-944c-f7ea30e3ff55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e118725-8e5e-42b3-b0be-418687f3e04c", "name": "network-vif-deleted", "tag": "da50cd30-9efb-4749-b60e-77651982c003"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:09:36.708931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-937ff2e6-7016-4a42-a3aa-a130ac813ec3 req-dbf15768-7a9d-4638-944c-f7ea30e3ff55 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:36.709685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-937ff2e6-7016-4a42-a3aa-a130ac813ec3 req-dbf15768-7a9d-4638-944c-f7ea30e3ff55 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:36.730972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-937ff2e6-7016-4a42-a3aa-a130ac813ec3 req-dbf15768-7a9d-4638-944c-f7ea30e3ff55 service nova] Creating event network-vif-deleted:da50cd30-9efb-4749-b60e-77651982c003 for instance 7e118725-8e5e-42b3-b0be-418687f3e04c on hv-cinder-78729 Jun 24 09:09:36.737201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-937ff2e6-7016-4a42-a3aa-a130ac813ec3 req-dbf15768-7a9d-4638-944c-f7ea30e3ff55 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043351 Jun 24 09:09:36.738337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 897/2087] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:09:37.675717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:37.676320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:37.683494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:37.684091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:37.685005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:37.685442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:37.703056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:37.748309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:37.755742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5911576-334a-4403-bcf9-acd9f67f2cbd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084064 Jun 24 09:09:37.756303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1191/2088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:38.773476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:38.774219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:38.780501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:38.780954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:38.781745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:38.782179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:38.843577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:38.851496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-07b0bcc4-473d-40fb-b325-4093ca1901a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082656 Jun 24 09:09:38.852064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 898/2089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:39.868626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:39.869180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:39.875647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:39.876605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:39.877363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:39.877834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:39.941878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:39.949431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b1bb33f-e825-4c55-acfa-943a17886f4d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084702 Jun 24 09:09:39.950022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1192/2090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:40.966350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:40.966960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:40.973329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:40.973797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:40.974551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:40.974982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:40.979056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:41.039900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:41.047353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f919ef00-eb88-448e-91c1-a793658326e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084864 Jun 24 09:09:41.048545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 899/2091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:42.065320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:42.065986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:42.072450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:42.072902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:42.073679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:42.074154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:42.134881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:42.142477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-613f02f4-84f4-4194-a173-8a7676e84c8c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081548 Jun 24 09:09:42.143033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1193/2092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:43.159345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:43.159951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:43.166678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:43.167122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:43.167873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:43.168302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:43.228600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:43.236393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-db62ca62-8027-478b-a864-7a6307163125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080396 Jun 24 09:09:43.236950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 900/2093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:44.253793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:44.254395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:44.260524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:44.260969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:44.261750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:44.262182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:44.325829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:44.334066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8ecf1524-7c53-4e33-8e23-5dab7b0e7b3b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084816 Jun 24 09:09:44.334825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1194/2094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:45.350853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:45.351472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:45.358084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:45.358530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:45.359287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:45.359719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:45.420095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:45.428311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-13c52e80-a5b9-4b6f-8fcb-720548903c3c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081317 Jun 24 09:09:45.428872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 901/2095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:46.444930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:46.445574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:46.447426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:46.448081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:46.454506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:46.454956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:46.455711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:46.456147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:46.516152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:46.523648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d82962b7-bffe-467d-be19-f2a292d2cebb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082557 Jun 24 09:09:46.524204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1195/2096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:47.540500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:47.541135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:47.547540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:47.548019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:47.549287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:47.549737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:47.608377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:47.616384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5150ef0-99f1-4569-a703-6e9849331500 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080037 Jun 24 09:09:47.616946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 902/2097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:48.632305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:48.632994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:48.639471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:48.639919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:48.640675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:48.641107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:48.702398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:48.709878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-80184d7e-42b4-48ee-a343-ec1f3fec50df tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081410 Jun 24 09:09:48.710431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1196/2098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:49.726520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:49.727124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:49.733527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:49.734018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:49.734768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:49.735198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:49.795145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:49.802520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b5af096-c4df-4f34-9fbd-40a0d5b87ab0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079820 Jun 24 09:09:49.803073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 903/2099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:50.819294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:50.819907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:50.826514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:50.826966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:50.827727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:50.828196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:50.889632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:50.897016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71e5e715-b2e3-4192-80a4-81e975e7cc23 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081639 Jun 24 09:09:50.897594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1197/2100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:51.914308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:51.914870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:51.921463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:51.921940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:51.922704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:51.923139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:51.981982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:51.989435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2215deab-7187-4727-9c1a-457680b35805 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079419 Jun 24 09:09:51.990034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 904/2101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:53.006715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:53.007316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:53.013705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:53.014156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:53.014897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:53.015326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:53.077824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:53.085216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f411e631-87b9-4135-b2bd-2531fca40d9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082365 Jun 24 09:09:53.085796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1198/2102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:54.101956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:54.102567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:54.108911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:54.109352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:54.110144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:54.111198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:54.401436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:54.409619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3894d83a-3b95-409f-8ced-57b4ac8cdf4c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.311588 Jun 24 09:09:54.410231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 905/2103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:55.426913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:55.427521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:55.434050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:55.434493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:55.435243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:55.435673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:55.494471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:55.502335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4e87947d-2e3e-4a83-8978-606500eca05d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079394 Jun 24 09:09:55.502897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1199/2104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:56.519455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:56.520068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:56.526637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:56.527083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:56.527837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:56.528266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:56.588073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:56.596255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c5af218-72d8-4b2a-a52b-6693ae53609d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081192 Jun 24 09:09:56.596831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 906/2105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:57.613623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:57.614276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:57.616678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=72 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:57.621797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:57.622242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:57.623132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:57.623562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:57.683628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:57.691434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b37d257-4437-416c-b4d1-23ac19597153 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082242 Jun 24 09:09:57.691995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1200/2106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:58.708220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:58.708829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:58.711117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:58.716370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:58.716833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:58.717580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:58.718039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:58.782191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:58.789916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6960a460-e95a-4950-9bfa-621431d0d480 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085580 Jun 24 09:09:58.790470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 907/2107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:09:59.807068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:09:59.807674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:09:59.814113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:59.814557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:59.815303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:09:59.815737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:09:59.874683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:09:59.882395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-adb8cbc6-aa34-453b-aab8-0bbc43fc9d5e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079165 Jun 24 09:09:59.882949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1201/2108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:09:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:00.898588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:00.899125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:00.905525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:00.906008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:00.906776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:00.907215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:00.966993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:00.974475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f34e12d5-b976-4c39-9ed1-996eff69acd7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079821 Jun 24 09:10:00.975034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 908/2109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:01.991237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:01.991778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:01.998306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:01.998755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:01.999512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:01.999946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:02.059949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:02.069003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3ce3e472-d4da-4cb0-8ac1-74cff57b58fe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081638 Jun 24 09:10:02.069572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1202/2110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:03.085547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:03.086183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:03.092771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:03.093225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:03.094026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:03.094520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:03.157031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:03.165352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-775476bc-1981-4b36-b99b-f8d1f6716c91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083656 Jun 24 09:10:03.165957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 909/2111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:04.181965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:04.182598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:04.190130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:04.190612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:04.191519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:04.191809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:04.253381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:04.260751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-13239f51-1934-4770-9015-1006df04cd02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082591 Jun 24 09:10:04.261314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1203/2112] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:05.277385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:05.278061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:05.285208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:05.285677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:05.286455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:05.287151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:05.346675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:05.354306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c391b38d-e3dd-4c3e-b32d-6d01ddd56b95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080455 Jun 24 09:10:05.354868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 910/2113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:06.371619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:06.372221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:06.379339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:06.379790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:06.384800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:06.384800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:06.442788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:06.450342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-12fbab00-cc48-4963-a3d1-c4a8e80a43dd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082508 Jun 24 09:10:06.450963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1204/2114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:07.467713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:07.468324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:07.474880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:07.475330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:07.476087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:07.476525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:07.538058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:07.545414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0aca2a25-3833-4ab4-84c3-0c1fe6fee0e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081650 Jun 24 09:10:07.546007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 911/2115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:08.561994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:08.562632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:08.569255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:08.569735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:08.570496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:08.570931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:08.573459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=81 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:08.631132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:08.638730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-88a3b1ba-6423-4922-9f28-827bcd1efca3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080556 Jun 24 09:10:08.639295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1205/2116] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:09.655871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:09.656482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:09.663208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:09.663656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:09.664412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:09.664838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:09.729821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:09.737345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78f37b50-74c3-45e2-8ca6-f80e934be69e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085276 Jun 24 09:10:09.737930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 912/2117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:10.753761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:10.754387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:10.760784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:10.761239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:10.762016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:10.762450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:10.822048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:10.829988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d0f8ef4c-327f-4548-a8c1-2ab46037c66c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079595 Jun 24 09:10:10.830545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1206/2118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:11.847360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:11.847964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:11.854425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:11.854876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:11.855626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:11.856059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:11.858855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=83 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:11.921431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:11.929927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-da696ca0-3f48-4436-9cff-5e6fcd4855c4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086938 Jun 24 09:10:11.930481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 913/2119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:12.946752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:12.947360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:12.953838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:12.954293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:12.955560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:12.955994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:13.014789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:13.022812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-78a5d1ee-2299-435a-9926-15946ad214be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079998 Jun 24 09:10:13.023371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1207/2120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:14.040163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:14.040777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:14.047187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:14.047637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:14.049055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:14.049493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:14.109086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:14.117257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b1e1bd8b-316f-4a97-84cb-73ba1f9cc6fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081263 Jun 24 09:10:14.117844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 914/2121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:15.134142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:15.134756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:15.141831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:15.142300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:15.143082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:15.143515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:15.203023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:15.210320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1fe0291c-726b-4a53-804e-e6a3d57ec27e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080049 Jun 24 09:10:15.210864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1208/2122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:16.227312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:16.227930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:16.234501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:16.234953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:16.235737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:16.236193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:16.298918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:16.306425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10142961-6aaa-4348-a7b4-ab88f9295f91 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083076 Jun 24 09:10:16.307007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 915/2123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:17.323849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:17.324466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:17.331519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:17.332001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:17.332760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:17.333197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:17.393266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:17.400901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8dc90c8-1cb1-4968-b32a-9dc1596f00b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080898 Jun 24 09:10:17.401472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1209/2124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:18.418369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:18.419002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:18.426236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:18.426692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:18.427444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:18.427879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:18.486958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:18.494293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a374bb5b-c03b-4fd0-a26c-4fa6551c69ec tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079793 Jun 24 09:10:18.494852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 916/2125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:19.510972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:19.511576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:19.518685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:19.519133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:19.519885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:19.520347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:19.581361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:19.588729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-000138ba-4d88-4e1f-bd46-c239ea3a569a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081617 Jun 24 09:10:19.589290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1210/2126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:20.606176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:20.607059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:20.614044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:20.614498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:20.615266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:20.615702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:20.678498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:20.685862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4261f017-7cca-4cfb-a346-27b1b528a449 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083519 Jun 24 09:10:20.686426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 917/2127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:21.702609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:21.703220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:21.710154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:21.710603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:21.711354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:21.711792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:21.775260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:21.782713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40aa5740-9974-46fe-b4fb-26cfec28cb0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083996 Jun 24 09:10:21.783268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1211/2128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:22.800932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:22.801575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:22.808102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:22.808549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:22.809312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:22.809780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:22.869210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:22.876649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e217e2d3-f641-4b52-ba2e-5172ba09da47 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080812 Jun 24 09:10:22.877211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 918/2129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:23.893559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:23.894130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:23.900505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:23.900950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:23.901726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:23.902163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:23.961732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:23.969040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-694cce13-e6c0-4ea5-9ce3-9511ce6b9686 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079421 Jun 24 09:10:23.970151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1212/2130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:24.986037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:24.986646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:24.993115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:24.993557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:24.994342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:24.994774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:25.058785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:25.066244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cbea062b-083f-49eb-8dc9-7c4b01b58073 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084060 Jun 24 09:10:25.066804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 919/2131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:26.083187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:26.083826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:26.090489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:26.090937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:26.091690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:26.092121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:26.151557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:26.159765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-88e353f4-f178-4ea8-bd53-485ef755df9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080508 Jun 24 09:10:26.160319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1213/2132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:27.177777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:27.178387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:27.184798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:27.185273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:27.186070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:27.186489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:27.247856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:27.256256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a4ab1972-42c5-4829-9220-82f9b1c0a59c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082336 Jun 24 09:10:27.256812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 920/2133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:28.273215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:28.273859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:28.276174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:28.281737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:28.282744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:28.283479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:28.283910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:28.343757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:28.351728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a0e4c3b3-9071-4129-a069-df678dda8d92 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082472 Jun 24 09:10:28.352288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1214/2134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:29.368768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:29.369379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:29.371790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:29.377783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:29.378232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:29.378997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:29.379429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:29.441973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:29.449374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5956a01-181b-4cc4-9067-1589e7803a24 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084447 Jun 24 09:10:29.449971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 921/2135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:30.466450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:30.466997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:30.474140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:30.474585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:30.475359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:30.475790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:30.535127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:30.542722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5027b88e-8be9-4024-b015-2831555cd508 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080247 Jun 24 09:10:30.543276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1215/2136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:31.233543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:10:31.233803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:10:31.559448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:31.560063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:31.566533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:31.566979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:31.567742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:31.568175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:31.628085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:31.635583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-797decf7-4eba-4ce5-8cd4-fafbba0c0c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079951 Jun 24 09:10:31.636136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 922/2137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:32.722715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:32.723321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:32.729545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:32.730042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:32.730799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:32.731233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:32.794068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:32.803091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62b8c737-8d94-49e5-bc1d-99effec97cb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.153966 Jun 24 09:10:32.803650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1216/2138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:33.820529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:33.821125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:33.827574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:33.828015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:33.829359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:33.829821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:33.940262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:33.947746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10edbcb1-b4d3-4cb9-9bf1-9f5169a76d20 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.131113 Jun 24 09:10:33.948298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 923/2139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:34.964330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:34.964939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:34.972153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:34.972598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:34.973347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:34.973810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:35.034475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:35.042722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87c70422-990e-48b7-a9b7-92fc52066117 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082269 Jun 24 09:10:35.043274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1217/2140] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:36.059430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:36.060035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:36.067151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:36.067591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:36.068342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:36.068775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:36.129133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:36.136570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3c50a443-f925-4b20-9ba5-dc34b2b2e298 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080983 Jun 24 09:10:36.137137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 924/2141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:37.154804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:37.155415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:37.162197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:37.162647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:37.163401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:37.163834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:37.275031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:37.283030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-40b441a2-6b38-499f-bb8f-0d3ef3ff30aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.132054 Jun 24 09:10:37.283632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1218/2142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:38.299920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:38.300530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:38.306985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:38.307430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:38.308181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:38.308612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:38.372010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:38.379979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ae589fcb-d81b-4a96-b710-7dfc75e00b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083904 Jun 24 09:10:38.380537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 925/2143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:39.397530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:39.398158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:39.404558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:39.405002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:39.405778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:39.406208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:39.409249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:39.466382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:39.474534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4e39beb3-ace6-4d5f-b0bf-d051600619ab tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081088 Jun 24 09:10:39.475100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1219/2144] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:40.491184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:40.491985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:40.498510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:40.498953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:40.499704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:40.500131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:40.559509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:40.567505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a68f2d3b-a956-4a4d-87c7-49fd05ef8ca5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080140 Jun 24 09:10:40.568071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 926/2145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:41.584747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:41.585424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:41.591946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:41.592391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:41.593139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:41.593568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:41.653392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:41.661727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-10b76c44-e5e5-4177-98d9-dc883b75b156 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080515 Jun 24 09:10:41.662279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1220/2146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:42.678071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:42.678681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:42.685058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:42.685508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:42.686294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:42.686722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:42.691075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:42.752694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:42.761493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-97861347-029f-463d-90d5-9e17a5e64afe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087267 Jun 24 09:10:42.762098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 927/2147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:43.749126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:10:43.749634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:10:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:10:43.782885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:43.783501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:43.790009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:43.790459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:43.791216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:43.791653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:43.852066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:43.859648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62787a1b-2c8d-4d18-a7ae-e8efcee9acf2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081057 Jun 24 09:10:43.860210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1221/2148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:44.876667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:44.877209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:44.883607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:44.884077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:44.884827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:44.885253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:44.945634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:44.953403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8502ba77-5b3d-450f-999a-d943276d4c4f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080690 Jun 24 09:10:44.953994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 928/2149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:45.971304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:45.971823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:45.978364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:45.978814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:45.979568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:45.980001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:46.042244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:46.049739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6bb1a2cd-970a-452d-a1ea-2319ac193d1f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083377 Jun 24 09:10:46.050296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1222/2150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:47.068294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:47.068904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:47.075590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:47.076045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:47.076841 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:47.077277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:47.139010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:47.146311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a899009e-7a36-485e-a112-67681d865bb1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081862 Jun 24 09:10:47.146874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 929/2151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:48.163381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:48.164004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:48.170416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:48.170859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:48.171645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:48.172577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:48.231151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:48.239036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18641fcd-99ad-4656-91e2-c9af7378e28b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079770 Jun 24 09:10:48.239589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1223/2152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:49.256629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:49.257162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:49.263555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:49.264003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:49.264759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:49.265199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:49.325396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:49.333651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e52b27c-a120-4dbe-a6a8-cb94235bd4d6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081000 Jun 24 09:10:49.334244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 930/2153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:50.350924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:50.351528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:50.357950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:50.358392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:50.359140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:50.359584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:50.420496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:50.427875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9fa96579-e04f-4805-a8b7-74e21f53ee75 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080850 Jun 24 09:10:50.428425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1224/2154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:51.445095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:51.445734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:51.452270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:51.452721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:51.453485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:51.453995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:51.516305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:51.524093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7c7429f-71f6-48aa-ad23-db3609e837e2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082853 Jun 24 09:10:51.524643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 931/2155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:52.541500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:52.542129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:52.549209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:52.549648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:52.550412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:52.550842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:52.615312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:52.622782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3fa3a0ff-3510-48e5-9962-1713d810f6ee tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085124 Jun 24 09:10:52.623334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1225/2156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:53.639847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:53.640456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:53.646910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:53.647351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:53.648101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:53.648528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:53.709067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:53.716484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5b05c9c6-f7ea-4694-8ba8-a5ed70e6b99e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080742 Jun 24 09:10:53.717073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 932/2157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:54.733170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:54.733811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:54.741099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:54.741553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:54.742341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:54.742777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:54.802721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:54.810240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d05b82dd-589c-45f5-87bb-29545640c1ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080930 Jun 24 09:10:54.810797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1226/2158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:55.827631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:55.828237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:55.834660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:55.835102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:55.835855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:55.836287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:55.901174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:55.908590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8fe2ee5-61a3-49aa-b71b-84417c2e03b9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084896 Jun 24 09:10:55.909338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 933/2159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:56.925535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:56.926151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:56.933194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:56.933634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:56.934419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:56.934846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:56.994371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:57.002211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-acfb5a6e-6a88-4990-a359-a1f205577e11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080613 Jun 24 09:10:57.002765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1227/2160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:58.019519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:58.020132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:58.026615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:58.027060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:58.027821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:58.028256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:58.087781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:58.096773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c61c1fcc-11f6-42da-8aab-8d96c9f7de09 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081316 Jun 24 09:10:58.097901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 934/2161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:10:59.114707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:10:59.115316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:10:59.117611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:59.123145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:59.123595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:59.124410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:10:59.124840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:10:59.184300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:10:59.191643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cfce7eb7-b22f-49c2-9c70-df605e2932a8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081339 Jun 24 09:10:59.192195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1228/2162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:10:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:00.208583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:00.209330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:00.211753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:00.217179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:00.217623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:00.218406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:00.218834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:00.281416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:00.289113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bac77fe4-0be3-4cb4-8708-4d56cedf4e82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084453 Jun 24 09:11:00.289708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 935/2163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:01.306288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:01.306912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:01.313829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:01.314271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:01.315015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:01.315470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:01.376484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:01.383993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-96296333-2d94-4c73-80f5-04aa1b574125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081520 Jun 24 09:11:01.384549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1229/2164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:02.400827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:02.401433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:02.408042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:02.408495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:02.409261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:02.409726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:02.468894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:02.476420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7dcfa1f0-d14f-4926-9d4c-40164580ea95 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079495 Jun 24 09:11:02.476990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 936/2165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:03.493767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:03.494386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:03.500952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:03.501403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:03.502207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:03.502643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:03.562946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:03.570393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4ff07e8d-9073-40bf-bc00-d96228f47996 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080568 Jun 24 09:11:03.570955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1230/2166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:04.587136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:04.587755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:04.594857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:04.595306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:04.596072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:04.596508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:04.659007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:04.666720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f6544331-549b-4785-b042-bd6a6cb3bf54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083501 Jun 24 09:11:04.667280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 937/2167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:05.683931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:05.684547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:05.691707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:05.692163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:05.692933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:05.693372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:05.754062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:05.761577 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4a23838e-d570-422a-9939-75fd80c1862a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081579 Jun 24 09:11:05.762184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1231/2168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:06.778536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:06.779150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:06.785496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:06.786227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:06.787018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:06.787446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:06.846486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:06.853800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-19a416df-42ee-4f5c-ae3d-f7b3a5314fa4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079077 Jun 24 09:11:06.854358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 938/2169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:07.871344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:07.871893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:07.878332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:07.878779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:07.879532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:07.879966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:07.946523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:07.954669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-50d58b00-0f90-4f63-badb-871247d37e87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087264 Jun 24 09:11:07.955234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1232/2170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:08.972213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:08.972696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:08.979376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:08.979829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:08.980629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:08.981064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:09.043708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:09.051795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c6b23fc2-4c2c-4c6a-b046-42cad674fe2b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084168 Jun 24 09:11:09.052353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 939/2171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:10.068378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:10.069019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:10.075549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:10.075998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:10.076752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:10.077185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:10.080230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:10.136990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:10.145111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2aab867c-906a-4de1-a00d-7129b3b20d67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080621 Jun 24 09:11:10.145694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1233/2172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:11.162696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:11.163332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:11.169799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:11.170246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:11.171004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:11.171436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:11.232988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:11.240940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d1e8196a-1637-4750-8430-3dc31c744ca6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082396 Jun 24 09:11:11.241501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 940/2173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:12.257001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:12.257636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:12.264109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:12.264555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:12.265305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:12.265762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:12.324691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:12.332095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33d640c4-4f7f-4a7c-8b74-d0a4c2664eef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078953 Jun 24 09:11:12.332657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1234/2174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:13.349397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:13.350064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:13.356595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:13.357033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:13.357816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:13.358242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:13.360745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:13.421830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:13.429438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-88674d33-857f-4d4a-b279-dfffdcaa7f69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083863 Jun 24 09:11:13.430031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 941/2175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:14.448027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:14.448546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:14.455003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:14.455455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:14.456210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:14.456643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:14.518882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:14.526249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0d67e78a-b056-4e84-86f7-2887358728e0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082326 Jun 24 09:11:14.526816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1235/2176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:15.543860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:15.544499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:15.551499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:15.551959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:15.552721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:15.553160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:15.612354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:15.619458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b64e089f-75e6-45cb-8d98-0464ae2d0c76 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079522 Jun 24 09:11:15.620050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 942/2177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:16.636266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:16.636875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:16.643927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:16.644377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:16.645132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:16.645565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:16.704498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:16.711826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a2e0e086-c0e3-4e5f-bfbb-c833cb092fc8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079391 Jun 24 09:11:16.712390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1236/2178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:17.728478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:17.729092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:17.735614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:17.736154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:17.736910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:17.737410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:17.800366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:17.807894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8fe86256-b4c6-4a8e-9ec0-364223be3cc3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083260 Jun 24 09:11:17.808453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 943/2179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:18.824550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:18.825140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:18.832118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:18.832565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:18.833316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:18.833783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:18.893967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:18.901341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ffef096f-7cca-49b3-995c-94f3296621f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080653 Jun 24 09:11:18.901932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1237/2180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:19.918507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:19.919051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:19.925170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:19.925618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:19.926428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:19.926857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:19.990874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:19.998496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-660dd773-2ce1-4b93-950e-a60c178bae40 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084106 Jun 24 09:11:19.999063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 944/2181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:21.015826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:21.016435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:21.023467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:21.023961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:21.024716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:21.025151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:21.084943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:21.092308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d5994ee2-b2f2-4df1-a9fe-3cfc7ada3c83 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080331 Jun 24 09:11:21.092871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1238/2182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:22.109040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:22.109645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:22.116724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:22.117164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:22.117944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:22.118372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:22.181480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:22.189099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ffb858eb-97b6-45b4-8280-11feda1d6b9c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083924 Jun 24 09:11:22.189818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 945/2183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:23.206063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:23.206669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:23.213087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:23.213534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:23.214319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:23.214754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:23.274104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:23.281480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e6145801-438f-45ea-85e4-8d4ebac91b11 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079254 Jun 24 09:11:23.282078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1239/2184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:24.299302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:24.299938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:24.306370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:24.306811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:24.307564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:24.307995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:24.367676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:24.375081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b929fea9-dfc6-4ab1-b1b3-93a22c39a8cc tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079641 Jun 24 09:11:24.375643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 946/2185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:25.392293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:25.393022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:25.399647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:25.400085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:25.400829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:25.401256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:25.460150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:25.467602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2bdf1de4-3b85-47da-b3ab-4f72cafcbfb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079166 Jun 24 09:11:25.468155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1240/2186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:26.484403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:26.485075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:26.491382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:26.491826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:26.492583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:26.493010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:26.556699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:26.564051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-26a7f176-2278-4a6a-be0e-576841b2d75b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083636 Jun 24 09:11:26.565204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 947/2187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:27.582138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:27.582754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:27.589252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:27.589758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:27.590516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:27.590951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:27.651049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:27.659221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-55a06d1c-c70e-4f0d-b9f5-7e3b14df32f3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081782 Jun 24 09:11:27.659775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1241/2188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:28.676763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:28.677400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:28.683882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:28.684335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:28.685106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:28.685544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:28.747266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:28.754671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ed96db3b-4aa1-43c7-9e85-54c3444e0d22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082378 Jun 24 09:11:28.755228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 948/2189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:29.771586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:29.772184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:29.774567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:29.781093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:29.781574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:29.782376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:29.782869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:29.854939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:29.863031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a4efafd-2fc5-40ca-939a-f30a79121c2a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.095252 Jun 24 09:11:29.863531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1242/2190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:30.883700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:30.884235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:30.886532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:30.893148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:30.893597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:30.894386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:30.894822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:30.956941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:30.964361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5c5a0ff-f495-4420-985e-1cea4566a5aa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084574 Jun 24 09:11:30.964924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 949/2191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:31.980379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:31.980923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:31.987394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:31.987845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:31.988604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:31.989053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:32.049923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:32.057474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-24c32eed-7d2d-4c2d-b4e1-5a0ea67a4e06 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081060 Jun 24 09:11:32.058073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1243/2192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:33.074600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:33.075217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:33.081781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:33.082236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:33.083007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:33.083451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:33.142621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:33.150017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c0b09208-03a4-4e12-93e3-ae4357efc76e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079211 Jun 24 09:11:33.150581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 950/2193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:34.167578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:34.168184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:34.175105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:34.175551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:34.176292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:34.176721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:34.235343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:34.243907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2799219f-e4fb-4c80-b39a-9242d9d9080c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080225 Jun 24 09:11:34.244465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1244/2194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:35.260860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:35.261379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:35.267899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:35.268340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:35.269092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:35.269519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:35.331820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:35.339820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-23618a81-6dcd-4b86-a1f1-94a05507568e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082916 Jun 24 09:11:35.340377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 951/2195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:36.356396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:36.357001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:36.363535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:36.363976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:36.365355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:36.365817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:36.425309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:36.432723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d605dfcd-fb0e-45cb-94e2-30641a86ae37 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080161 Jun 24 09:11:36.433280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1245/2196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:37.449401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:37.450048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:37.456432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:37.456879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:37.457636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:37.458167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:37.517380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:37.524807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-06c8f57e-292a-49ff-855f-ddcfbcd47224 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079252 Jun 24 09:11:37.525362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 952/2197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:38.541698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:38.542260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:38.548674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:38.549153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:38.549936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:38.550383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:38.611393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:38.619421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f967d224-4a76-453c-a334-0b0b411e7622 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081699 Jun 24 09:11:38.619971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1246/2198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:39.636403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:39.637009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:39.643822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:39.644267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:39.645022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:39.646007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:39.710471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:39.717848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9091e6ec-088e-431a-98bd-28af7f1ec892 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085581 Jun 24 09:11:39.718418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 953/2199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:40.736765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:40.737394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:40.744113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:40.744651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:40.745421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:40.745877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:40.748354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:40.805795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:40.813115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e9730df9-038c-4be3-a2b4-8cf11f3e575e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080561 Jun 24 09:11:40.813691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1247/2200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:41.829949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:41.830608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:41.837469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:41.837939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:41.838690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:41.839118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:41.899203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:41.906605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0e44abb-002e-4adc-9de9-f0e5d9f81066 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080789 Jun 24 09:11:41.907155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 954/2201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:42.924425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:42.924963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:42.932055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:42.932506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:42.933272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:42.933730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:42.995024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:43.002458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c006009a-9e1e-42d8-9653-4345937968b2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082036 Jun 24 09:11:43.003016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1248/2202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:44.019335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:44.019954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:44.026438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:44.026883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:44.027653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:44.028086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:44.030620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:44.094934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:44.102393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-439b3fad-2686-47e2-a62a-7dbd9f77c293 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086974 Jun 24 09:11:44.102946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 955/2203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:45.120080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:45.120685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:45.126683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:45.127135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:45.127883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:45.128314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:45.200671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:45.208146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d6eb705e-c592-4e42-8d85-1dafd26dc1f2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.092185 Jun 24 09:11:45.208702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1249/2204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:46.224356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:46.224992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:46.231586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:46.232039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:46.232805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:46.233247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:46.292917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:46.300412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-56540b81-9be3-4f5e-adaa-0700deab6283 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080007 Jun 24 09:11:46.300975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 956/2205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:47.318059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:47.318987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:47.325237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:47.325700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:47.326455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:47.326883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:47.388035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:47.396228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a456d73f-8ce7-4434-9105-79865013076e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082554 Jun 24 09:11:47.396797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1250/2206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:48.414001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:48.414606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:48.421013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:48.421450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:48.422238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:48.422668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:48.484146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:48.491493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a92c9340-8cfd-4d9a-ac99-322897a8ee1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082176 Jun 24 09:11:48.492050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 957/2207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:49.508105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:49.508755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:49.515156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:49.515605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:49.516412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:49.516846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:49.576175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:49.583713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4dab8a27-f277-479c-a53d-df798017ebef tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079448 Jun 24 09:11:49.584257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1251/2208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:50.600191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:50.600798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:50.606944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:50.607392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:50.608152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:50.608586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:50.668574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:50.677219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2b878839-b5f8-41de-bd2b-314969e33e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080894 Jun 24 09:11:50.677794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 958/2209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:51.694564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:51.695175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:51.701607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:51.702082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:51.702835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:51.703270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:51.763043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:51.771128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-435ac21e-8405-4b46-aadb-5404767eac1c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080422 Jun 24 09:11:51.771688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1252/2210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:52.788575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:52.789201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:52.795625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:52.796069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:52.796822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:52.797254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:52.859664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:52.867724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f6c224d6-e455-4403-99ad-ef4dda2559d0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083394 Jun 24 09:11:52.868222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 959/2211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:53.885078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:53.885625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:53.892163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:53.892617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:53.893377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:53.893859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:53.953313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:53.960790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-921ef563-3609-40e6-8a9f-6cc515daa3a0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079739 Jun 24 09:11:53.961355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1253/2212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:54.978295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:54.978845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:54.985194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:54.985638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:54.986429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:54.986864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:55.049013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:55.056683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ebbb5d74-e190-40c1-893e-09fba02aaa7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082275 Jun 24 09:11:55.057259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 960/2213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:56.073748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:56.074367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:56.080848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:56.081294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:56.082965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:56.083453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:56.145845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:56.153274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d4defa20-a35f-476a-a317-636fb3fa4a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083424 Jun 24 09:11:56.153863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1254/2214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:57.171164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:57.171777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:57.179104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:57.179547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:57.180308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:57.180742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:57.242163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:57.249604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-51660f82-24ff-4d34-9180-3efdc6daa068 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082210 Jun 24 09:11:57.250157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 961/2215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:58.266408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:58.267023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:58.273677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:58.274164 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:58.274916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:58.275350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:58.336504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:58.343879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-96d86f78-b863-449b-99f5-441cd0b907e1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081379 Jun 24 09:11:58.344436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1255/2216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:11:59.359802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:11:59.360412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:11:59.366883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:59.367327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:59.368081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:11:59.368521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:11:59.428393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:11:59.435865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-50c96141-6340-4e6c-9468-6415e061aceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079884 Jun 24 09:11:59.436427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 962/2217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:11:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:00.452223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:00.452839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:00.455159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:00.460466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:00.460915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:00.461695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:00.462126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:00.522602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:00.530013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8c1a5f1b-25ca-4613-a351-07244ab0861f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081605 Jun 24 09:12:00.530569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1256/2218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:01.547109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:01.547721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:01.550047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:01.555315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:01.555761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:01.556524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:01.556957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:01.619122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:01.626582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9cc074fa-5ad2-4bcd-abfb-d1165b0b7351 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083371 Jun 24 09:12:01.627138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 963/2219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:02.644059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:02.645160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:02.651649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:02.652111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:02.652874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:02.653305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:02.712766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:02.720232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d91690ce-dbf7-4f0b-826d-53306bb92da3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080053 Jun 24 09:12:02.720795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1257/2220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:03.737907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:03.739435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:03.746080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:03.746523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:03.747275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:03.747704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:03.808355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:03.820374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a9ab85a3-9e51-4add-ba27-75f481a91ceb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086200 Jun 24 09:12:03.820947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 964/2221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:04.836861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:04.837449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:04.843923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:04.844370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:04.845127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:04.845557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:04.904684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:04.912371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-74a2182e-f022-4c2a-8d7b-721eb52b930e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079356 Jun 24 09:12:04.912936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1258/2222] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:05.929388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:05.929960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:05.936296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:05.936735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:05.937481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:05.937934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:05.999879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:06.007813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a51b9126-0283-41f8-af38-480a25e771f7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082414 Jun 24 09:12:06.008368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 965/2223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:07.024360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:07.024974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:07.031438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:07.031888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:07.032646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:07.033082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:07.093537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:07.101392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0905d95c-e86e-458c-9a61-0e583cde5ff0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080859 Jun 24 09:12:07.102000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1259/2224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:08.118879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:08.119487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:08.126047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:08.126519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:08.127270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:08.127697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:08.193394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:08.200696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c24d2e76-6d78-4f68-989c-6987c1d2ecd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085625 Jun 24 09:12:08.201259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 966/2225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:09.217323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:09.217948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:09.224454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:09.224900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:09.225642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:09.226100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:09.286939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:09.294382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f401c680-20c9-45d8-b090-d47376f7b138 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080912 Jun 24 09:12:09.294944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1260/2226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:10.311765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:10.312383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:10.319000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:10.319443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:10.320231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:10.320657 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:10.385182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:10.392586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3a922f09-bb40-44ce-b9f7-4702b8aad071 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084686 Jun 24 09:12:10.393141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 967/2227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:11.410774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:11.411440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:11.417842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:11.418293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:11.419046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:11.419479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:11.422005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:11.481789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:11.489877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9ea5d93-5dbe-463f-a3dc-fce3d6ed4468 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083838 Jun 24 09:12:11.490429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1261/2228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:12.507302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:12.507942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:12.514417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:12.514864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:12.515626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:12.516056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:12.575400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:12.582806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-958041d0-19d2-4d36-bfb0-fdb9172f67b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080035 Jun 24 09:12:12.583370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 968/2229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:13.599565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:13.600167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:13.606242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:13.606685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:13.607431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:13.607856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:13.667283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:13.674608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7732a06-9309-4fd5-a0cd-499ccc22906d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078971 Jun 24 09:12:13.675165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1262/2230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:14.691301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:14.691914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:14.698329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:14.698778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:14.699540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:14.699975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:14.703835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:14.762601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:14.770498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d18a17fd-0d0b-49cd-b887-6598f02a7154 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083103 Jun 24 09:12:14.771058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 969/2231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:15.787735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:15.788340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:15.794841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:15.795291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:15.796050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:15.796486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:15.856649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:15.865121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-238f0581-6b35-4213-8b63-b29ff38fc3b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081863 Jun 24 09:12:15.865848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1263/2232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:16.882643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:16.883291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:16.889684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:16.890141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:16.890903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:16.891335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:16.951959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:16.959444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-46087162-8b96-46e2-8c11-7719b1cd440b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081352 Jun 24 09:12:16.960012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 970/2233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:12:17.976888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:17.977442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:17.983930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:17.984380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:17.985134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:17.985567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:18.045174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:18.052494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a3f39af6-4818-43ac-931c-2df032fac2db tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079525 Jun 24 09:12:18.053046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1264/2234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:19.069244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:19.069883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:19.076411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:19.076860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:19.077619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:19.078081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:19.139985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:19.147866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-05660480-c6b8-4393-9ef3-5ce9afa256f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082503 Jun 24 09:12:19.148428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 971/2235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:20.165415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:20.166052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:20.172602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:20.173052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:20.173837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:20.174271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:20.238762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:20.246319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a71a47fb-b4c8-4dcf-a44f-d4487fa2ba48 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084785 Jun 24 09:12:20.246883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1265/2236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:21.263872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:21.264489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:21.270615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:21.271062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:21.271829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:21.272259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:21.331201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:21.338557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a247bb5d-3779-4bbf-b51a-a01146412326 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078712 Jun 24 09:12:21.339118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 972/2237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:22.355398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:22.356015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:22.363082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:22.363529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:22.364318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:22.364757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:22.423370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:22.431331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c2cf5263-911d-4ec0-bdd4-7ba4615c41ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079802 Jun 24 09:12:22.431899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1266/2238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:23.099839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:12:23.100331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:12:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:12:23.448128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:23.448740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:23.455219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:23.455669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:23.457018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:23.457449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:23.521239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:23.528817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-37f5ac15-19c8-4e29-aecb-77f3c70ac4c3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084486 Jun 24 09:12:23.529380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 973/2239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:24.546169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:24.546709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:24.553149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:24.553595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:24.554376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:24.554810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:24.614796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:24.622407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9608a89a-1048-4f6f-a740-6079fde18c3f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080196 Jun 24 09:12:24.622964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1267/2240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:25.639254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:25.639860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:25.646316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:25.646760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:25.647515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:25.647945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:25.709926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:25.717337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-357e9ac3-767d-40a8-9253-83c0881d991b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081922 Jun 24 09:12:25.717921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 974/2241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:26.734271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:26.734906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:26.741365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:26.741854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:26.742610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:26.743041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:26.803797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:26.811196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b317a04c-4733-4ad0-adf9-3f9f4240c74e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080801 Jun 24 09:12:26.811756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1268/2242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:27.828035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:27.828639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:27.834999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:27.835440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:27.836191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:27.836616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:27.906716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:27.915108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9dbe6127-9584-4f07-b1d2-3e00bf9dd853 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.090844 Jun 24 09:12:27.915674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 975/2243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:28.145895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:12:28.146096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:12:28.933574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:28.934149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:28.940601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:28.941048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:28.941832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:28.942266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:29.001236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:29.008948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48a8254a-1ebe-4d7c-9624-4d12fe2d5563 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079333 Jun 24 09:12:29.009508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1269/2244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:30.025794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:30.026436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:30.032958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:30.033405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:30.034192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:30.034623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:30.094083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:30.101382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e8365b1-7ccf-447e-978d-f59385a2ae02 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079525 Jun 24 09:12:30.101972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 976/2245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:31.117927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:31.118541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:31.120974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:31.126660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:31.127115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:31.127879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:31.128319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:31.186266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 24 09:12:31.186594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:12:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c (ip 10.222.0.48) !!! Jun 24 09:12:31.189819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:31.198456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5dc73996-fec4-44b9-9a8e-0294b62dd30e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084406 Jun 24 09:12:31.199530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1270/2246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:32.216307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:32.216986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:32.219267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:32.225172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:32.225622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:32.226433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:32.226862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:32.288999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:32.301260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d74e8de-deb8-49ce-8d2d-1732fface976 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.088619 Jun 24 09:12:32.302092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 977/2247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:33.318604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:33.319243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:33.325679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:33.326139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:33.326892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:33.327331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:33.386780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:33.394638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-66e14ed3-fecd-4239-b447-2ba6c178f78d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079955 Jun 24 09:12:33.395191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1271/2248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:34.411485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:34.412097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:34.418528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:34.418983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:34.419740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:34.420175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:34.479885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:34.487873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b30f5f4-0c7c-4b77-94bb-25611d672140 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079837 Jun 24 09:12:34.488428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 978/2249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:35.504685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:35.505291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:35.512189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:35.512632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:35.513374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:35.513834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:35.572881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:35.580199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ebb5c2ea-9779-4312-a6a1-75cbdc64bec7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079457 Jun 24 09:12:35.580759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1272/2250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:36.597732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:36.598281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:36.604677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:36.605098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:36.605891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:36.606317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:36.668291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:36.676213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7f45770-535d-4862-badd-e386466fca9b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082517 Jun 24 09:12:36.676770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 979/2251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:12:37.693290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:37.693925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:37.700405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:37.700849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:37.701605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:37.702095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:37.762617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:37.770090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1e1f4ab0-174d-4fc4-b2bc-49c4680c0831 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081099 Jun 24 09:12:37.770654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1273/2252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:38.787306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:38.787913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:38.794397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:38.794847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:38.795609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:38.796045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:38.858097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:38.866078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4ea9b0ed-9340-48d9-8be5-f7da286584be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082844 Jun 24 09:12:38.866577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 980/2253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:39.882982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:39.883525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:39.889938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:39.890381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:39.892117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:39.892546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:39.956597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:39.964190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c4463a7a-d567-45a6-b1a6-498def760684 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085137 Jun 24 09:12:39.964756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1274/2254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:40.981514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:40.982105 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:40.989047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:40.989490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:40.990288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:40.990715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:41.052810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:41.060226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-797facb6-bd13-42e5-ba3f-b0fb00be0331 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082683 Jun 24 09:12:41.060776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 981/2255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:42.077763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:42.078381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:42.085580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:42.086074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:42.086838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:42.087274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:42.091130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:42.146323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:42.153627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b48d0077-70ad-4b90-9dbc-3bff2dabd0ed tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079818 Jun 24 09:12:42.154216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1275/2256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:43.170593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:43.171234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:43.177771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:43.178222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:43.178980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:43.179416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:43.241399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:43.249030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b11fdc28-2cb3-426b-9fee-427dbd9f295d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082275 Jun 24 09:12:43.249595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 982/2257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:44.266167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:44.266755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:44.272924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:44.273366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:44.274137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:44.274567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:44.333307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:44.340692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-794ce2b7-3743-492f-bf4f-fe1064bfc094 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078390 Jun 24 09:12:44.341249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1276/2258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:45.358273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:45.358883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:45.365353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:45.365843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:45.366602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:45.367038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:45.370909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:12:45.429864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:45.437166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0fbb3fec-e11b-4643-8e89-904512ff6024 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082822 Jun 24 09:12:45.437738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 983/2259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:46.453826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:46.454446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:46.461455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:46.461934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:46.462681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:46.463108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:46.522822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:46.530227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2519e3ff-f35f-480c-8a6a-878c32f3f3f9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080444 Jun 24 09:12:46.530780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1277/2260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:47.547525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:47.548292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:47.555179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:47.555625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:47.556384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:47.556820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:47.616890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:47.624351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3425e0cf-d99b-4dbe-a77f-2b12339da8ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080697 Jun 24 09:12:47.624910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 984/2261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:48.640270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:48.640877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:48.647320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:48.647763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:48.648509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:48.648938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:48.708155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:48.715492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5663cc27-e18e-4bfb-acc3-3a975d5b5d6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079073 Jun 24 09:12:48.716055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1278/2262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:49.733081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:49.733712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:49.739732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:49.740179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:49.740928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:49.741358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:49.802855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:49.810201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3966bac8-25ff-4aab-9fb8-1a03a7aaee7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081457 Jun 24 09:12:49.811027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 985/2263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:50.827304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:50.827935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:50.834944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:50.835392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:50.836147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:50.836590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:50.895912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:50.903447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fbada699-10a1-4fda-9ff0-4258d9ea4d65 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080029 Jun 24 09:12:50.904014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1279/2264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:51.921153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:51.921818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:51.928808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:51.929254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:51.930034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:51.930470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:51.990304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:52.000779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-016aeca8-164a-4089-96b1-dca932789f55 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083204 Jun 24 09:12:52.001852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 986/2265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:53.017923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:53.018573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:53.025264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:53.025586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:53.026371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:53.026803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:53.086166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:53.093463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-60fbb09b-df02-4653-bbaf-434d1481ecf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079422 Jun 24 09:12:53.094058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1280/2266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:54.110569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:54.111169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:54.118185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:54.118629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:54.119383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:54.119811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:54.183798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:54.191209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7a913e01-2dd5-4f7b-96d1-ac3c3eeee81a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084479 Jun 24 09:12:54.191760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 987/2267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:54.592157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:12:54.592406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:12:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:12:55.207872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:55.208478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:55.215044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:55.215488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:55.216235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:55.216664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:55.277566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:55.285199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-403287b6-cac3-4839-bff5-4d864edf8e97 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081001 Jun 24 09:12:55.285774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1281/2268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:56.302141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:56.302752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:56.309092 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:56.309534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:56.310320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:56.310748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:56.369872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:56.377713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-28114922-05b3-43eb-8f22-348f635c847a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079989 Jun 24 09:12:56.378273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 988/2269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:57.394625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:57.395196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:57.401478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:57.401952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:57.402698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:57.403125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:57.461724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:57.469014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-18f2f07c-dbde-4655-b157-05b8fa3f5595 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078449 Jun 24 09:12:57.469565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1282/2270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:58.485697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:58.486385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:58.492656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:58.493095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:58.493871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:58.494299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:58.555975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:58.564283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-32555164-0edc-4446-9411-747172c8d4b1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082437 Jun 24 09:12:58.565581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 989/2271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:12:59.582339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:12:59.582949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:12:59.589376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:59.589877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:59.590639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:12:59.591077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:12:59.651470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:12:59.658915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f9d829bb-27c2-4fbb-93bd-51013d8f53b8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081080 Jun 24 09:12:59.659743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1283/2272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:12:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:00.676033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:00.676647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:00.683146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:00.683595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:00.684357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:00.684788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:00.744199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:00.751678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cba13861-477f-45f6-ab17-d3c841f4c2ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079547 Jun 24 09:13:00.752738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 990/2273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:01.769598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:01.770255 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:01.772738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:01.778047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:01.778499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:01.779256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:01.779693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:01.839845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:01.847278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-874f3915-5909-4776-97bb-2fe913664e4e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082170 Jun 24 09:13:01.847841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1284/2274] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:02.864312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:02.864864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:02.867263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:02.872737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:02.873179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:02.873963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:02.874396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:02.936361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:02.943865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dbb975ff-ee64-42b9-adc8-6afd6bd11125 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083521 Jun 24 09:13:02.944409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 991/2275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:03.960218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:03.960823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:03.967358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:03.967803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:03.968546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:03.968972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:04.028230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:04.036456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c3f278d6-0c7c-4d0a-9bdf-db52e8f5715e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080070 Jun 24 09:13:04.037004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1285/2276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:05.052856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:05.053466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:05.059940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:05.060389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:05.061158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:05.061593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:05.124024 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:05.132197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-43282162-e906-4903-bf51-93756e0273ac tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083762 Jun 24 09:13:05.132756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 992/2277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:06.149922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:06.150534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:06.156976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:06.157423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:06.158218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:06.158659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:06.219024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:06.226546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-76897672-6be7-44f1-a82c-c3ca13460299 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080513 Jun 24 09:13:06.227123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1286/2278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:07.243581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:07.244309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:07.250827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:07.251276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:07.252045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:07.252481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:07.317787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:07.325152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4229eb1a-0b53-4c82-b4b3-b8c5a5031c64 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085471 Jun 24 09:13:07.325719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 993/2279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:08.342417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:08.343092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:08.350011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:08.350457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:08.351207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:08.351637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:08.410995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:08.424965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4aa6ba05-6031-4bec-ac4d-6e976b5c78b6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086391 Jun 24 09:13:08.425526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1287/2280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:09.440895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:09.441438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:09.447798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:09.448243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:09.449020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:09.449447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:09.508850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:09.516184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee8888f6-6ef9-48a6-af52-e46c90f2e82b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079168 Jun 24 09:13:09.516737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 994/2281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:10.533854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:10.534717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:10.541074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:10.541515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:10.542290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:10.542721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:10.605073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:10.613134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9d3ad354-bfab-4040-b895-a25f384ee096 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083608 Jun 24 09:13:10.613715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1288/2282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:11.630512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:11.631128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:11.637545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:11.638025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:11.638783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:11.639217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:11.705171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:11.712740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-acc59cf3-fa86-4cee-a192-d292e4880eb4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086766 Jun 24 09:13:11.713297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 995/2283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:12.729473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:12.730103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:12.736559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:12.737001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:12.737778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:12.738206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:12.740938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:12.799546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:12.806887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7711a93b-6765-441b-9ece-addbd8123b67 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081223 Jun 24 09:13:12.807444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1289/2284] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:13.824096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:13.824707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:13.831965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:13.832409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:13.833171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:13.833600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:13.892776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:13.900181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5a0c529b-7455-43f4-9eab-b470b105d356 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079937 Jun 24 09:13:13.900731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 996/2285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:14.917501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:14.918081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:14.924235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:14.924679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:14.925423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:14.925897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:14.984829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:14.992268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cd67b6d-6f62-4350-b004-8e0a7527629a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078886 Jun 24 09:13:14.992827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1290/2286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:16.009069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:16.009620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:16.016049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:16.016500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:16.017317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:16.017816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:16.021754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:16.084904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:16.092439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-357a2a51-8729-4eb9-b47c-abcff58e2797 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087314 Jun 24 09:13:16.093002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 997/2287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:17.109815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:17.110426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:17.117437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:17.117927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:17.118682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:17.119112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:17.178439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:17.185828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b22d761a-5141-4e3d-b040-115f17aa6025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079896 Jun 24 09:13:17.186390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1291/2288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:18.203319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:18.203927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:18.210431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:18.210879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:18.211642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:18.212081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:18.271352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:18.278755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2b6f4d4a-7732-45c5-be4d-74f55b8a11cd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079316 Jun 24 09:13:18.279312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 998/2289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:19.296526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:19.297136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:19.304161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:19.304609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:19.305361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:19.305821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:19.365739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:19.373149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5d21e618-44ca-4de7-9479-0114b09d4bcd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080519 Jun 24 09:13:19.373727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1292/2290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:20.390107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:20.390715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:20.397218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:20.397688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:20.398442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:20.398870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:20.460809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:20.474129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a3cdfa9f-a4d7-46dd-beb8-0160ed90115c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087983 Jun 24 09:13:20.474693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 999/2291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:21.491330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:21.491969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:21.498269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:21.498714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:21.499461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:21.499894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:21.559422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:21.566832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2f580257-0713-4504-9e57-ca42f79438a9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079582 Jun 24 09:13:21.567385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1293/2292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:22.584078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:22.584676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:22.591128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:22.591574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:22.592325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:22.592751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:22.653996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:22.661561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98824b25-b6ef-4294-bcfd-2916896f35c6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081986 Jun 24 09:13:22.662144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1000/2293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:23.678314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:23.678920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:23.685288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:23.685756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:23.686508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:23.686934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:23.745776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:23.753383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3eeeb110-e3cf-4c75-9394-509841410422 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078884 Jun 24 09:13:23.754002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1294/2294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:24.770393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:24.771033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:24.777517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:24.777989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:24.778742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:24.779170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:24.992423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:24.999854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-986f1050-3284-4308-b84d-82d2ae894e29 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.233311 Jun 24 09:13:25.000403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1001/2295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:26.015747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:26.016364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:26.023053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:26.023506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:26.024264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:26.024702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:26.086542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:26.093781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-08a6a6aa-d9e9-45ad-9d54-1ed48bb3b510 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081865 Jun 24 09:13:26.094342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1295/2296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:27.110615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:27.111804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:27.118148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:27.118589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:27.119339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:27.119767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:27.179396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:27.186669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-db84f25f-4ebc-4069-bcb3-83923c8a74e6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079915 Jun 24 09:13:27.187210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1002/2297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:28.203324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:28.203924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:28.210364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:28.210805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:28.211548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:28.211976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:28.271050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:28.278750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed942f6a-3bf2-4fa7-a897-9f0b5cc85868 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079021 Jun 24 09:13:28.279736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1296/2298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:29.302740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:29.303279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:29.309902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:29.310348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:29.311101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:29.311533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:29.373942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:29.381315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a0664f90-378e-49bd-83fb-be519a6f3c87 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083057 Jun 24 09:13:29.381906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1003/2299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:30.398623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:30.399228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:30.405887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:30.406336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:30.407087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:30.407518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:30.466524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:30.475733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed79e2cc-d437-4409-93dc-4035e9894670 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080676 Jun 24 09:13:30.476707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1297/2300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:31.493752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:31.494365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:31.500794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:31.501240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:31.502601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:31.503033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:31.565325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:31.572965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-520066a0-bdc0-424e-91d9-f8df3dc6888a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083115 Jun 24 09:13:31.573935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1004/2301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:32.591065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:32.591666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:32.594025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:32.599874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:32.600328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:32.601085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:32.601519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:32.661475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:32.668848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d30228c4-e30c-4e3c-bd34-805b33bcba3a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081673 Jun 24 09:13:32.669417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1298/2302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:33.686319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:33.686930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:33.689745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:33.694903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:33.695341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:33.696095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:33.696525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:33.758022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:33.765403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4e5e9bc0-0ddd-4f28-8c77-5f1a4803cf0b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082927 Jun 24 09:13:33.765982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1005/2303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:34.782891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:34.783570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:34.790280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:34.790724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:34.791471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:34.791900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:34.850877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:34.858298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f4276d12-4d83-46c1-8bd2-77cbf4d4cf21 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079351 Jun 24 09:13:34.858972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1299/2304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:35.875315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:35.875875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:35.883097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:35.883550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:35.884307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:35.884739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:35.944097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:35.951548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cb4330af-8c33-4bab-bcb3-08aee9249fea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080185 Jun 24 09:13:35.952095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1006/2305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:36.968272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:36.968884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:36.976025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:36.976473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:36.977222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:36.977672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:37.037245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:37.044960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b5e6973b-750f-40fb-a357-5343c51d3caf tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080541 Jun 24 09:13:37.045549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1300/2306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:38.062509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:38.063124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:38.069582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:38.070065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:38.070831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:38.071266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:38.137938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:38.146546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ab35c5c3-d560-4d17-ac91-73e2447a6bc4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087893 Jun 24 09:13:38.147108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1007/2307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:39.164118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:39.164658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:39.171125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:39.171602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:39.172358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:39.172790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:39.234220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:39.242243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-52ac33a4-93fe-49b8-896a-666f6f141833 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082090 Jun 24 09:13:39.242807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1301/2308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:40.259410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:40.259971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:40.266478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:40.266925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:40.267688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:40.268624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:40.327736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:40.335622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-29fe00c3-264c-445b-8b8e-369209fe1ce1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080278 Jun 24 09:13:40.336169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1008/2309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:41.352191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:41.352828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:41.359301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:41.359744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:41.360522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:41.360951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:41.422896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:41.431178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71b9cf1c-5982-4ff3-aa72-093bf2a8ca99 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082807 Jun 24 09:13:41.431736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1302/2310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:42.448296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:42.448885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:42.455415 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:42.455862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:42.456619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:42.457053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:42.524259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:42.531848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b818dd7-4256-4253-b22a-e03b38298db3 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087565 Jun 24 09:13:42.532400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1009/2311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:43.548834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:43.550092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:43.556403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:43.556848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:43.557634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:43.558089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:43.560583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:43.618388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:43.626114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ddfe7df-6da7-4152-bef1-050811c69b0a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081029 Jun 24 09:13:43.626807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1303/2312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:44.645997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:44.646622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:44.653447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:44.653934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:44.654709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:44.655142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:44.715796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:44.723366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-106e1cb8-15cd-42b2-abef-3d8103b9cc05 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084195 Jun 24 09:13:44.723924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1010/2313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:45.740078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:45.740690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:45.747151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:45.747602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:45.748392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:45.748827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:45.809196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:45.816626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-724e30d0-a392-4c75-8491-098e5cf1d4f6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081025 Jun 24 09:13:45.817191 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1304/2314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:46.833433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:46.834136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:46.840813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:46.841264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:46.842075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:46.842508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:46.846364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:46.904568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:46.912289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c90e4f30-d9be-4341-9678-f281c2033bd6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082740 Jun 24 09:13:46.912852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1011/2315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:46 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:47.929258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:47.929891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:47.936333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:47.936776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:47.937521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:47.937981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:47.997220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:48.005125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f621cb39-f003-41ce-a1e3-0a347da649ad tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079829 Jun 24 09:13:48.005707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1305/2316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:49.022543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:49.023167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:49.029653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:49.030140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:49.030911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:49.031348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:49.096099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:49.103489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e46c69b9-be65-4e46-8348-5555e1d06cfb tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084808 Jun 24 09:13:49.104044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1012/2317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:50.120651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:50.121259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:50.127757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:50.128204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:50.128953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:50.129385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:50.188992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:50.196971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85799bac-23c8-4e89-847c-03c516e2cbb2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080161 Jun 24 09:13:50.197533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1306/2318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:51.214627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:51.215239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:51.221951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:51.222401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:51.223160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:51.223592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:51.241977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:13:51.242465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:13:51.286567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:51.294016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6af4dc32-ef13-41c2-a35a-0ad185871963 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083273 Jun 24 09:13:51.294577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1013/2319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:52.311010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:52.311628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:52.318631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:52.319075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:52.319822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:52.320251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:52.379054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:52.386357 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ae89cf8e-b7aa-44f2-8ecd-60a85c119d69 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079202 Jun 24 09:13:52.386908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1307/2320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:53.403240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:53.403773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:53.410496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:53.410940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:53.411697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:53.412129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:53.472912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:53.480370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3053ad73-8cb5-481d-929e-3b44f74f4603 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081143 Jun 24 09:13:53.480925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1014/2321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:54.496459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:54.497106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:54.503835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:54.504286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:54.505042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:54.505471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:54.567930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:54.575445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4f4c583b-8c10-4582-86fc-80785de98f22 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082905 Jun 24 09:13:54.576037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1308/2322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:55.592379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:55.592994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:55.599990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:55.600438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:55.601198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:55.601633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:55.663706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:55.671074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5e954259-11bc-4562-bc03-e957473df809 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082553 Jun 24 09:13:55.671634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1015/2323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:56.687509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:56.688117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:56.695262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:56.695706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:56.696487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:56.696918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:56.755697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:56.763091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-03ba3172-3cb6-4b07-b813-d5bc69f90d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079388 Jun 24 09:13:56.763641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1309/2324] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:57.779768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:57.780379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:57.787168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:57.787616 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:57.788402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:57.788838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:57.847815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:57.855253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-919fd9ec-6e86-4227-9a5a-fa6dc5f59808 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079304 Jun 24 09:13:57.855814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1016/2325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:57 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:58.872628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:58.873165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:58.879724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:58.880178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:58.880932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:58.881363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:58.940768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:13:58.948236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a31ae59-da05-48e7-ab8c-68b70a06857a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079517 Jun 24 09:13:58.948803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1310/2326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:13:59.965193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:13:59.965840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:13:59.972323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:59.972768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:13:59.973523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:13:59.973985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:00.036751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:00.044524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cd3df0f4-b65c-4ff3-9252-e1a2da2d4667 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083141 Jun 24 09:14:00.045079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1017/2327] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:13:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:01.061344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:01.061977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:01.069025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:01.069487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:01.070256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:01.070683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:01.129380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:01.136710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0c0a743e-a342-4227-9bdd-66b57457e411 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079214 Jun 24 09:14:01.137271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1311/2328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:02.154064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:02.154677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:02.162041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:02.162490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:02.163252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:02.163794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:02.224487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:02.233897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-862c8b9f-835e-4e69-b09f-2b71504318a4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083688 Jun 24 09:14:02.234469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1018/2329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:03.250789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:03.251397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:03.253712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:03.258944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:03.259391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:03.260147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:03.260580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:03.319917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:03.327264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9236ce19-d154-4df4-abf0-6295f20ca016 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080371 Jun 24 09:14:03.327825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1312/2330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:03.756930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:14:03.757087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:14:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:14:04.344661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:04.345316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:04.347603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:04.352827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:04.353279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:04.354059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:04.354490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:04.416858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:04.424815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-896bed48-f684-48f6-beb1-6cf4df43a029 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084074 Jun 24 09:14:04.425369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1019/2331] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:05.441105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:05.441683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:05.448084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:05.448558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:05.449312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:05.449765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:05.509208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:05.516541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7f7ff863-b2c5-4dbd-8d61-a98ad5c77d98 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079342 Jun 24 09:14:05.517124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1313/2332] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:06.533420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:06.534324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:06.540725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:06.541175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:06.541968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:06.542406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:06.607431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:06.612306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c939f684-c50b-46c6-81e8-b5aef8ab93ea tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082760 Jun 24 09:14:06.612902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1020/2333] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:07.629044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:07.629654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:07.636112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:07.636560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:07.637319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:07.637778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:07.697204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:07.704636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-70a41cd2-c827-4471-b12b-f10fb2a1d884 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079490 Jun 24 09:14:07.705200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1314/2334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:08.721515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:08.722157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:08.728677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:08.729125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:08.729914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:08.730351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:08.791601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:08.799543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f00c643e-ae00-45db-b8aa-662e3fcccc01 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081965 Jun 24 09:14:08.800096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1021/2335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:09.816759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:09.817362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:09.824046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:09.824488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:09.825230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:09.825673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:09.886143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:09.893988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-05bfb04e-5949-4e76-8327-e445559267e9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081535 Jun 24 09:14:09.894542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1315/2336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:09 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:10.910945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:10.911459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:10.917949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:10.918401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:10.919172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:10.919607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:10.978757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:10.986209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-01f0f8a4-f417-4158-bcec-554857530738 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080057 Jun 24 09:14:10.986769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1022/2337] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:12.004454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:12.005524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:12.012011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:12.012457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:12.013208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:12.013638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:12.074830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:12.082225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7995c4ae-ba4c-44d4-a233-a086ffb9a341 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082766 Jun 24 09:14:12.082775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1316/2338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:13.099299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:13.099976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:13.106442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:13.106892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:13.107658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:13.108097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:13.169564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:13.177462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ddb014f-fc0e-4054-b052-e56e33de1a2c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082113 Jun 24 09:14:13.178053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1023/2339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:14.194929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:14.195547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:14.201802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:14.202259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:14.203016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:14.203458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:14.208073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:14.269432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:14.276938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-613e85f9-4c0f-44c4-a720-6f425863d246 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085917 Jun 24 09:14:14.277500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1317/2340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:14:15.294023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:15.294638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:15.301576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:15.302049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:15.302816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:15.303251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:15.362579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:15.369888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4b396da2-1937-4aa7-aa83-a52ba312060d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079864 Jun 24 09:14:15.370445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1024/2341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:16.386858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:16.387467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:16.393981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:16.394438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:16.395188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:16.395621 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:16.454886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:16.462292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f924dae5-de18-41b8-a781-6ea5589b30fa tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079243 Jun 24 09:14:16.462792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1318/2342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:17.479355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:17.479965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:17.486401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:17.486835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:17.487596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:17.488028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:17.490642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:17.551934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:17.559347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4a150b7e-3d93-4414-806e-4f8b7e4c8bf8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083828 Jun 24 09:14:17.559901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1025/2343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:18.576725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:18.577325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:18.584258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:18.584698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:18.585439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:18.585896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:18.645535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:18.652937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d5a2e044-884b-423a-9683-4f7424407e8e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080010 Jun 24 09:14:18.653493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1319/2344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:19.670845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:19.671489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:19.678283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:19.678732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:19.679497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:19.679934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:19.739039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:19.746572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d138cfcb-0a72-4280-b5bd-4f820df5ace2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079790 Jun 24 09:14:19.747139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1026/2345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:20.764022 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:20.764634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:20.771864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:20.772337 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:20.773083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:20.773508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:20.833078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:20.840470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dbc3e919-f347-4d14-82fb-557a82e7b025 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080358 Jun 24 09:14:20.841020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1320/2346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:20 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:21.857911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:21.858502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:21.865577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:21.866016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:21.866772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:21.867200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:21.930769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:21.938482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d89b8d1-dc97-4e71-954d-7cd96eebe7be tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084464 Jun 24 09:14:21.939225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1027/2347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:22.956037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:22.956678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:22.962942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:22.963387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:22.964130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:22.964558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:23.024620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:23.032094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-17778202-f910-4658-92a8-e8ffc4e25571 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080011 Jun 24 09:14:23.032644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1321/2348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:24.055082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:24.055725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:24.062267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:24.062721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:24.063487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:24.063951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:24.122808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:24.130293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c75abf1a-0e50-431c-94db-0b8e61805f7d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079140 Jun 24 09:14:24.130857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1028/2349] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:25.146508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:25.147110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:25.153470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:25.153940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:25.154685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:25.155115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:25.215882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:25.223128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0f984329-0ec2-4d5b-84eb-037e9d960be9 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080429 Jun 24 09:14:25.223689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1322/2350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:14:26.239999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:26.240636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:26.247060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:26.247507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:26.248267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:26.248698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:26.314587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:26.322057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd6299a0-3459-40da-a28a-744f80f9ebd4 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085959 Jun 24 09:14:26.322615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1029/2351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:27.339476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:27.340026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:27.347061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:27.347504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:27.348254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:27.348680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:27.408641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:27.416481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0439d59a-849b-4b5e-8bf0-ed76e27dae82 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080931 Jun 24 09:14:27.417038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1323/2352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:28.434093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:28.434689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:28.441584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:28.442067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:28.442820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:28.443253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:28.501498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:28.509304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b61aad09-996b-4c78-9f67-e2d997e37de2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079098 Jun 24 09:14:28.509887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1030/2353] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:29.526776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:29.527384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:29.534189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:29.534633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:29.535389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:29.535817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:29.595160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:29.602555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86bf0191-e0d5-4f5a-91fb-3d8b6d05047b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079692 Jun 24 09:14:29.603111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1324/2354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:30.619998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:30.620767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:30.627750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:30.628184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:30.628951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:30.629385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:30.690695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:30.700723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb9d5a90-e94a-4619-a557-e6320fb99393 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084617 Jun 24 09:14:30.701283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1031/2355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:30 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:14:31.718053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:31.718669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:31.725791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:31.726243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:31.726994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:31.727424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:31.791183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:31.798656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7213d573-9fcd-4844-b9df-7887871372e7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084474 Jun 24 09:14:31.799221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1325/2356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:32.816141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:32.816745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:32.823269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:32.823762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:32.824610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:32.825038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:32.886731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:32.894290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eee728f5-02cb-46d2-abbb-7eb4b461a54a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082696 Jun 24 09:14:32.895041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1032/2357] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:33.913020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:33.913592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:33.915831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:33.921185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:33.921625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:33.922394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:33.922847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:33.982489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:33.990411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-949f640c-89dd-4cb1-9653-dbf4b013ee61 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082061 Jun 24 09:14:33.990969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1326/2358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:35.007962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:35.008568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:35.010840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:35.015984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:35.016428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:35.017181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:35.017612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:35.087558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:35.095008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fe3eda31-de79-45e7-bd13-32fbfc5bf1d5 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.090953 Jun 24 09:14:35.095548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1033/2359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:36.112313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:36.112924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:36.119483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:36.119930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:36.120682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:36.121114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:36.180070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:36.187388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-58e36ad6-2af8-4900-af31-163d7d5c539a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079517 Jun 24 09:14:36.187941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1327/2360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:36 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:37.204041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:37.204658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:37.211141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:37.211593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:37.212366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:37.212802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:37.273916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:37.281355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f00e90f7-4734-4db3-a2fd-53bae423c925 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081215 Jun 24 09:14:37.281950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1034/2361] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:37 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:38.297825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:38.298433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:38.305481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:38.305968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:38.306728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:38.307162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:38.368740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:38.376174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-00989613-6f37-407c-a1f8-9396f03ee741 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082265 Jun 24 09:14:38.376731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1328/2362] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:38 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:39.393424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:39.394002 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:39.400428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:39.400881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:39.401650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:39.402108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:39.464850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:39.472374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8358fa10-fc7d-4603-8f71-93e9794336c0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082871 Jun 24 09:14:39.472914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1035/2363] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:39 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:40.489127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:40.489775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:40.496348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:40.496850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:40.497610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:40.498069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:40.557468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:40.565317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8c5f2ed-8ff4-4984-b22d-72ce8484a1ae tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079540 Jun 24 09:14:40.565907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1329/2364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:40 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:41.582157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:41.582759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:41.589438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:41.589935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:41.590695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:41.591123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:41.651271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:41.658613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0d9ac228-fa82-4752-8bcb-de249b5282fd tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080305 Jun 24 09:14:41.659437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1036/2365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:41 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:42.676310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:42.676917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:42.683527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:42.683978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:42.684731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:42.685165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:42.746061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:42.753833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fbcd18c2-7d88-46ee-9dfc-03c1c6ef6aff tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081962 Jun 24 09:14:42.754398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1330/2366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:42 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:43.770831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:43.771471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:43.777911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:43.778357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:43.779114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:43.779540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:43.842167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:43.849571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1fcfb7e5-156c-48fe-be80-6958a499d1c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082622 Jun 24 09:14:43.850152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1037/2367] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:43 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:44.867276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:44.867827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:44.873741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:44.874198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:44.874950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:44.875383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:44.878558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:44.938638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:44.946206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d743f85f-7cc9-4447-863e-0483b73edd6c tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083109 Jun 24 09:14:44.946775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1331/2368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:44 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:45.962949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:45.963498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:45.969988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:45.970438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:45.971719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:45.972157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:46.031883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:46.040267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-03d2d9bf-c94a-45db-bc6e-db11cf359d15 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081624 Jun 24 09:14:46.040831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1038/2369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:45 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:47.056232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:47.056872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:47.063413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:47.063861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:47.064608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:47.065043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:47.125068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:47.133002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-16f6dc0d-966a-45e6-a534-d97901a08594 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080621 Jun 24 09:14:47.133564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1332/2370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:47 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:48.149913 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:48.150535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:48.157148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:48.157601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:48.158406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:48.159635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:48.163681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:14:48.220959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:48.228961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7c85630d-669a-4af3-a52e-0c44e151e458 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082931 Jun 24 09:14:48.229567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1039/2371] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:48 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:49.246518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:49.247132 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:49.254355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:49.254831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:49.255565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:49.255999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:49.315880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:49.323373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d823bdcc-9d26-47b4-85c7-20a5dabc18b7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080682 Jun 24 09:14:49.323955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1333/2372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:49 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:50.340486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:50.341140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:50.347689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:50.348141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:50.348928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:50.349370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:50.411931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:50.422840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b0d8b835-f550-4877-8ac6-d26801a7d723 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.086078 Jun 24 09:14:50.423903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1040/2373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:50 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:51.440959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:51.441531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:51.448065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:51.448519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:51.449281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:51.449748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:51.508565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:51.515884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32897645-47b0-45cf-9370-a44fb8b27c4b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079510 Jun 24 09:14:51.516455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1334/2374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:51 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:52.532631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:52.533270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:52.540219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:52.540667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:52.541419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:52.541889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:52.603245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:52.610740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-90b9e1c9-6e15-446e-a47c-8b53cfe54d04 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081966 Jun 24 09:14:52.611851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1041/2375] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:52 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:53.627508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:53.628147 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:53.635056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:53.635510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:53.636266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:53.636705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:53.698547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:53.706389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a1194dee-2bfd-4749-9793-9edb346f2a03 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082752 Jun 24 09:14:53.706951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1335/2376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:53 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:54.723701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:54.724310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:54.730698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:54.731137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:54.731884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:54.732309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:54.792645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:54.800996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4c6a527e-7548-416a-9fc9-d009ebbdc345 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081717 Jun 24 09:14:54.801557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1042/2377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:54 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:55.818144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:55.818757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:55.825185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:55.825636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:55.826436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:55.826879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:55.886664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:55.894490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9482f0a7-3f9f-48e3-828a-615234e7cf7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080320 Jun 24 09:14:55.895051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1336/2378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:55 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:56.912186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:56.912765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:56.919189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:56.919637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:56.920420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:56.920854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:56.983123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:56.991496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-28f90549-5c1c-43c6-83db-73622f8cf30f tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.084022 Jun 24 09:14:56.992052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1043/2379] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:56 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:58.009246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:58.009905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:58.016405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:58.016846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:58.017594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:58.018059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:58.084819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:58.092477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fe0be81f-fe42-46b3-ae4a-35692905c50b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087204 Jun 24 09:14:58.093038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1337/2380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:58 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:14:59.109412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:14:59.110064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:14:59.116652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:59.117108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:59.117905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:14:59.118345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:14:59.179059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:14:59.186478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bd249e0f-ee45-487f-b671-5c218d74a699 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081008 Jun 24 09:14:59.187040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1044/2381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:14:59 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:00.203859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:00.204443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:00.210808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:00.211242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:00.211993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:00.212428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:00.273620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:00.281044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b33bf576-2929-4f04-9d1b-c4be2bd0329b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081092 Jun 24 09:15:00.281608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1338/2382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:00 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:01.298738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:01.299870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:01.306336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:01.306770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:01.307533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:01.307970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:01.369265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:01.376649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-43a80163-c102-4f87-a950-554f305daf30 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081819 Jun 24 09:15:01.377209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1045/2383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:01 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:02.394655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:02.395257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:02.401642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:02.402149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:02.402884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:02.403319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:02.463658 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:02.475471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-33e4bdd3-d0b6-488a-bf94-3a79e064f178 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085354 Jun 24 09:15:02.476032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1339/2384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:02 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:03.492996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:03.493561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:03.500047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:03.500490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:03.501241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:03.501690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:03.561047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:03.569263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-103f7c25-c29c-4bf3-b6af-43521a35aee1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080230 Jun 24 09:15:03.569924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1046/2385] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:03 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:04.585885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:04.586513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:04.588899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:04.594389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:04.594838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:04.595595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:04.596024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:04.655880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:04.664050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-660a74b7-8d5c-448f-8ef0-1c6a454ac04a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081980 Jun 24 09:15:04.664609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1340/2386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:04 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:05.681120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:05.681858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:05.684171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:05.689722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:05.690782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:05.691535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:05.691967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:05.758394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:05.766562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb560c3a-4408-4bae-bf48-7fdf1751ca70 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.089350 Jun 24 09:15:05.767119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1047/2387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:05 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:06.783602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:06.784286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:06.791156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:06.791612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:06.792367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:06.792799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:06.851995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:06.865454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-038cada1-f0d7-46e8-8fb7-f40d980d8c8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.085665 Jun 24 09:15:06.866060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1341/2388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:06 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:07.883446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:07.884081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:07.890817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:07.891262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:07.892020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:07.892446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:07.952183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:07.959692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c042f9b6-8bb8-4e14-8c96-2462bcdcdee2 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080494 Jun 24 09:15:07.960250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1048/2389] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:07 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:08.976867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:08.977423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:08.983971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:08.984411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:08.985161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:08.985588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:09.046734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:09.054821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2a480a03-f211-466e-a196-d3ef37829cc0 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081878 Jun 24 09:15:09.055382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1342/2390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:08 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:10.072388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:10.072998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:10.079610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:10.080062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:10.080866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:10.081301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:10.143775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:10.151325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e644ad6-b278-4374-9839-ea7e0310cff6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082870 Jun 24 09:15:10.151890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1049/2391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:10 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:11.168196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:11.168804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:11.175301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:11.175747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:11.176498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:11.176928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:11.235988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:11.243454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f094a14-6f9f-4860-a57b-7ccfd946b150 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079104 Jun 24 09:15:11.244015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1343/2392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:11 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:12.260764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:12.261402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:12.267927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:12.268918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:12.269704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:12.270144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:12.329471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:12.337341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-18b0e5a3-9bb4-4c83-bcc3-d2c54ea96f26 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080625 Jun 24 09:15:12.337935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1050/2393] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:12 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:13.354903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:13.355437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:13.361552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:13.362029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:13.362779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:13.363211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:13.423694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:13.431129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3789cb2-5038-4d93-ba08-f6d7ac055b8a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080120 Jun 24 09:15:13.431694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1344/2394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:13 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:14.448399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:14.449009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:14.455617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:14.456085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:14.456845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:14.457280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:14.520405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:14.527920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b2e1f09f-9b79-4ed3-ab05-5df97ca9afe6 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.083477 Jun 24 09:15:14.528479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1051/2395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:14 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:15.545630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:15.546288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:15.553284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:15.553759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:15.554505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:15.554931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:15.557399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=84 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:15.616225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:15.623719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4b6c8dd0-0e2a-4257-ad7d-fb69690f4f51 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081937 Jun 24 09:15:15.624270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1345/2396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:15 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:16.640232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:16.640837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:16.647901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:16.648353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:16.649109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:16.649545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:16.709070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:16.716390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7bf9eb9e-4536-4543-824a-2f5caf997ff1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080040 Jun 24 09:15:16.716953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1052/2397] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:16 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:17.732960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:17.733575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:17.740584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:17.741038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:17.741827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:17.742264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:17.801631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:17.809031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ce376c9d-d4df-49ea-bd48-0ebc3f4196f1 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079979 Jun 24 09:15:17.809586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1346/2398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:17 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:18.826250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:18.826870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:18.834113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:18.834568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:18.835330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:18.835765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:18.838306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=84 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:18.902807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:18.910574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7a68d130-6290-4ef6-88f4-597081cb6d19 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.087967 Jun 24 09:15:18.911137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1053/2399] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:18 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:19.926263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:19.926828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:19.933182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:19.933624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:19.934401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:19.934826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:19.993485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:20.000797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f422e113-a333-4547-a9f6-c2f41bb2502e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078374 Jun 24 09:15:20.001354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1347/2400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:19 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:21.017421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:21.018062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:21.024248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:21.024700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:21.025459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:21.025921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:21.085230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:21.092782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b96446c6-99c3-4dba-9c7c-d68c6cde1fb8 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079219 Jun 24 09:15:21.093340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1054/2401] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:21 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:22.110117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:22.110731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:22.117829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:22.118286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:22.119134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:22.119511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:22.178855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:22.186113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6730ad62-8f3e-4ac7-8755-95ed6839a26b tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079870 Jun 24 09:15:22.186670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1348/2402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:22 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:23.203491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:23.204131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:23.211096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:23.211549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:23.212307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:23.212738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:23.274713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:23.282212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-475a8712-48f8-4bb6-ad8d-9b307f195496 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.082587 Jun 24 09:15:23.282770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1055/2403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:23 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:24.298934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:24.299608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:24.305989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:24.306431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:24.307172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:24.307598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:24.367804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:24.375515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0b8113e3-3a1e-497b-8e2a-27eec96c282e tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080403 Jun 24 09:15:24.376072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1349/2404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:24 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:25.392313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:25.392878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:25.399344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:25.399785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:25.400532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:25.400961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:25.459659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:25.467137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-38320739-d5ac-44d6-8428-97b10a70f355 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.078754 Jun 24 09:15:25.467698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1056/2405] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:25 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:26.484653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:26.485197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:26.492267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:26.492716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:26.493471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:26.493948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:26.709834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:26.717203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7b0a1876-46c1-4b42-8fcf-c35ab1fe485d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.236764 Jun 24 09:15:26.717802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1350/2406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:26 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:27.733014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:27.733618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:27.740004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:27.740442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:27.741192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:27.741612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:27.803257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:27.810618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-86d52b0b-e505-4de1-98cb-71d3afec1e54 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081482 Jun 24 09:15:27.811169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1057/2407] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:27 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:28.828009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:28.828608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:28.835600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:28.836039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:28.836810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:28.837236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:28.896063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:28.903478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7bf5d7db-d886-4c68-9209-27d756996c90 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079272 Jun 24 09:15:28.904013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1351/2408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:28 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:29.920462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:29.921008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:29.928214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:29.928665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:29.929425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:29.929889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:29.988139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:29.996072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f24cb43e-eede-4f91-b609-5e6396d40e7a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079609 Jun 24 09:15:29.996632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1058/2409] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:29 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:31.012832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:31.013398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:31.019843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:31.020289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:31.021039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:31.021465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:31.080972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:31.089019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06fa3678-34e3-4e8c-89fa-d17899e94d1d tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.080100 Jun 24 09:15:31.089566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1352/2410] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:31 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:32.220248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:32.220894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:32.226838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:32.227285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:32.228047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:32.228487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:32.291983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:32.299477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2994bcc4-6032-48e7-a684-8f7c1ea7aefe tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.196498 Jun 24 09:15:32.300070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1059/2411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:32 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:33.317354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:33.318002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:33.324398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:33.324839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:33.325599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:33.326033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:33.384496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:33.391838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d98915db-0f81-4c8a-857a-6d56d4a380ce tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.079005 Jun 24 09:15:33.392377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1353/2412] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:33 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:34.409460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:34.410095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:34.418878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:34.419693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:34.420553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:34.420994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:34.531983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:34.540166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7a2d1cd9-cea6-46e8-84e4-5675b87f68c7 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.135312 Jun 24 09:15:34.540802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1060/2413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:34 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:35.557578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:35.558222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [instance: 7e118725-8e5e-42b3-b0be-418687f3e04c] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:35.560520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:35.566108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:35.566556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:35.567317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:35.567752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:35.627530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8b46b6c10644dcb5891acd98f1e5fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '315d35baa7c248a99083fc857a7e09e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:35.635047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a068d33e-b333-44a4-b02d-11d624d63b1a tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c" status: 200 len: 1220 microversion: 2.1 time: 0.081308 Jun 24 09:15:35.635600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1354/2414] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:35 2022] GET /compute/v2.1/servers/7e118725-8e5e-42b3-b0be-418687f3e04c => generated 1220 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:35.799866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7ba3d06d-ca6c-4595-a06e-0a779cb44a73 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] Calling method '.version_select at 0x7fa690056940>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:35.803132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ba3d06d-ca6c-4595-a06e-0a779cb44a73 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [9b616b0b-e421-4ddf-8469-2ec90f44096c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 09:15:36.811753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ba3d06d-ca6c-4595-a06e-0a779cb44a73 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] [9b616b0b-e421-4ddf-8469-2ec90f44096c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57748. Jun 24 09:15:36.818033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=28 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:36.830076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7ba3d06d-ca6c-4595-a06e-0a779cb44a73 tempest-TestShelveInstance-2116569762 tempest-TestShelveInstance-2116569762-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1024103265" status: 202 len: 0 microversion: 2.1 time: 1.034117 Jun 24 09:15:36.830647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1061/2415] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 24 09:15:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1024103265 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:15:37.949481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:37.950564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:37.957903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:37.958542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:37.959477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:37.960100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.009593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:15:38.071075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:38.071833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:38.082289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.083650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.084752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.085443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.100381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [24d413d9-0f2c-44db-98ce-86327710f7b4] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 09:15:38.116905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:15:38.201552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2defe98b-4fec-478c-8b5b-d7f64c4919d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 204 len: 0 microversion: 2.20 time: 0.136909 Jun 24 09:15:38.202819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1062/2416] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 24 09:15:38 2022] DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:15:38.209147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:38.209763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:38.215999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.216602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.217461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.217923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.251791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:15:38.333182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7b786ba1-87b3-47c7-8a5c-90a68f95777e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 204 len: 0 microversion: 2.1 time: 0.128741 Jun 24 09:15:38.333899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1063/2417] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:15:38 2022] DELETE /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:15:38.339366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:38.340180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:38.346118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.346570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.347340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.347772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.494776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:38.505289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:38.507113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:38.508324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b439186c-05bb-43e9-83e4-bae57dce2d70 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.173321 Jun 24 09:15:38.510244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1064/2418] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:38.515004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bc897dd0-7716-4576-86e0-726fcbebfa4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] Calling method '.version_select at 0x7fa68c0fe5e0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:38.539441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bc897dd0-7716-4576-86e0-726fcbebfa4c tempest-TestVolumeBootPattern-748779858 tempest-TestVolumeBootPattern-748779858-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-763813610" status: 202 len: 0 microversion: 2.1 time: 0.027983 Jun 24 09:15:38.544760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1065/2419] 10.222.0.48 () {58 vars in 1259 bytes} [Fri Jun 24 09:15:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-763813610 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:15:38.545472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:38.546243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:38.552799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.553358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.554238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:38.554739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:38.741817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:38.750049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4d073257-07d4-4995-8ca4-afca7c0c1a63 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1598 microversion: 2.1 time: 0.208584 Jun 24 09:15:38.750748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1066/2420] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1598 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:39.113203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [24d413d9-0f2c-44db-98ce-86327710f7b4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 57782. Jun 24 09:15:39.163610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ddf41512-ef3f-44c2-94e4-5cd005d23001 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 204 len: 0 microversion: 2.1 time: 1.217611 Jun 24 09:15:39.167374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1355/2421] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:15:37 2022] DELETE /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 0 bytes in 1219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:15:39.172464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:39.173098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:39.184047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.184503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.188533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.188994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.441678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:39.449355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6eee4522-efd6-4ba3-8424-40fe5ab19f45 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1682 microversion: 2.1 time: 0.280777 Jun 24 09:15:39.450279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1067/2422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:39 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1682 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:39.529870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:39.530564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:39.537682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.538364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.539135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.539563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.768614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:39.769361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:39.776468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.776921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.777872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:39.778368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:39.797849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:39.875480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:39.884997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:39.886512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:39.887716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5c4e9df5-b251-4176-a004-9274993d7f2f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.362272 Jun 24 09:15:39.888524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1356/2423] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:40.002312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:40.011568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-546204aa-2525-4f6b-adb6-acdd38dc49e0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1598 microversion: 2.1 time: 0.247252 Jun 24 09:15:40.012713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1068/2424] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1598 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:40.467706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:40.468347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:40.476038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:40.476488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:40.477257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:40.477706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:40.827761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:40.838437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0054adac-4710-4f0b-b5b0-aac345cb1978 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1682 microversion: 2.1 time: 0.374519 Jun 24 09:15:40.856211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1357/2425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:40 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1682 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:40.909214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:40.910972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:40.925152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:40.925600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:40.926417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:40.926881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.029599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:41.030364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:41.044278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:41.047901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.048916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:41.054225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.238832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:41.263835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b791c3d3-1576-4a84-b23f-81326a8f32d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1556 microversion: 2.1 time: 0.235326 Jun 24 09:15:41.269791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1358/2426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1556 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:41.381338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-08c397be-5da1-433a-bd30-d58be67461e8 req-151f0058-db65-4243-bdea-8cc9bfdab74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312c2-feed-4676-9667-bcfc1f8c0a34", "name": "network-vif-deleted", "tag": "de413bfc-c50c-48a1-8075-b9aa0f5c74d0"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:41.388899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:41.399845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:41.400090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-08c397be-5da1-433a-bd30-d58be67461e8 req-151f0058-db65-4243-bdea-8cc9bfdab74f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:41.401815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-08c397be-5da1-433a-bd30-d58be67461e8 req-151f0058-db65-4243-bdea-8cc9bfdab74f service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.413801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:41.415038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b2554f30-9fcc-4bc9-954b-ef7b5e57a57b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.511994 Jun 24 09:15:41.427466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1069/2427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:41.433014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-08c397be-5da1-433a-bd30-d58be67461e8 req-151f0058-db65-4243-bdea-8cc9bfdab74f service nova] Creating event network-vif-deleted:de413bfc-c50c-48a1-8075-b9aa0f5c74d0 for instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 on hv-cinder-78729 Jun 24 09:15:41.443173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-08c397be-5da1-433a-bd30-d58be67461e8 req-151f0058-db65-4243-bdea-8cc9bfdab74f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169508 Jun 24 09:15:41.444864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1359/2428] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:15:41.856425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:41.857049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:41.863498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:41.865116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.866140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:41.866755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:41.959259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:41.971697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-27b6ca44-0f43-4058-a97b-a821c489c4bb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 200 len: 1614 microversion: 2.1 time: 0.119072 Jun 24 09:15:41.985194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1070/2429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:41 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 1614 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:42.292693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:42.294338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:42.307522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:42.310703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:42.315498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:42.316101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:42.433351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:42.434324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:42.441268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:42.442701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:42.446864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:42.447656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:42.474619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:42.486371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:42.511377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-35260a2d-efad-424e-b8b2-18acb5bb1c27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.227674 Jun 24 09:15:42.512574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1360/2430] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:42.699894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:42.712473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:42.714274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:42.717687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-74e1c58f-a988-408a-b1fa-db24f295f648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.288409 Jun 24 09:15:42.718805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1071/2431] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:42.992051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:42.992695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:43.013723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.014451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.015844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.016558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.053951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f HTTP/1.1 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:15:43.059976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:15:43.061883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '8da110a3-8877-41cf-b6a1-bc17120e309f'} Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:15:43.062925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:15:43.064527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:15:43.065882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:15:43.065882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-44c85b20-67b3-48c7-9e50-d0e9b9182f74 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 404 len: 111 microversion: 2.1 time: 0.074574 Jun 24 09:15:43.065882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1361/2432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:42 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:15:43.072269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-584e50d7-89e3-466b-8eef-80503b0130a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '.version_select at 0x7fa68c174160>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:43.097946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-584e50d7-89e3-466b-8eef-80503b0130a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-357587012" status: 202 len: 0 microversion: 2.1 time: 0.029221 Jun 24 09:15:43.098577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1072/2433] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 24 09:15:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-357587012 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:15:43.467192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-c4e52d76-d06f-4806-afb8-31c78397103b req-eee4f684-f045-4164-949d-62c4bb944ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da110a3-8877-41cf-b6a1-bc17120e309f", "name": "network-vif-deleted", "tag": "b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:43.487773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c4e52d76-d06f-4806-afb8-31c78397103b req-eee4f684-f045-4164-949d-62c4bb944ebe service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.488416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c4e52d76-d06f-4806-afb8-31c78397103b req-eee4f684-f045-4164-949d-62c4bb944ebe service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.515047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-c4e52d76-d06f-4806-afb8-31c78397103b req-eee4f684-f045-4164-949d-62c4bb944ebe service nova] Creating event network-vif-deleted:b15bb9c5-255b-4adb-a5b1-01c5bf3a3f2f for instance 8da110a3-8877-41cf-b6a1-bc17120e309f on hv-cinder-78729 Jun 24 09:15:43.528640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:43.529817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:43.534141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-c4e52d76-d06f-4806-afb8-31c78397103b req-eee4f684-f045-4164-949d-62c4bb944ebe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071976 Jun 24 09:15:43.537947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.539231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1362/2434] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:15:43.540087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.541251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.542317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.688757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:43.698456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3bcc962d-3c25-4ab9-b36e-792ffe186363 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.173675 Jun 24 09:15:43.702772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1073/2435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:43.738739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:43.740048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:43.747758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.748267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.749046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:43.749486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:43.981648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:43.991371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:43.993449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:43.995187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5e0f4e2f-4b99-4536-a1f7-d0354e96b66e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.262291 Jun 24 09:15:43.996473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1363/2436] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:44.623729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0e6b756d-f42d-4032-9bc3-1703d5495732 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: .version_select at 0x7fa690056280>, body: {"keypair": {"name": "tempest-keypair-114522886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3ne1s+aiYb0xPOgALEvPMHo41OFnWmrX7IvTBxUi/E5GmnRmuOCN003A5oVRvlrVpPRd+IV1TFJqmH0+tgHkscRDo3ofzjVDLdrFUqOfO1zgiIZGVQL7Vcj0Ph5/p3wA=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:44.643476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-0e6b756d-f42d-4032-9bc3-1703d5495732 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:15:44.648731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-0e6b756d-f42d-4032-9bc3-1703d5495732 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:15:44.676378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0e6b756d-f42d-4032-9bc3-1703d5495732 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056870 Jun 24 09:15:44.683914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1074/2437] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 09:15:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:15:44.720888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:44.722298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:44.732528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:44.733275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:44.735107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:44.735714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:44.832321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:44.848678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5a39a8a0-0439-489f-9db3-a7c52b41d47e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.132513 Jun 24 09:15:44.850126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1364/2438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:45.015898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:45.016516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:45.024033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:45.024744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:45.025747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:45.026359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:45.329531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:45.340223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:45.343843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:45.345363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-457fb920-7f6b-4ea5-94cc-09d22ca3ffbb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.333496 Jun 24 09:15:45.352293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1075/2439] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:15:45.866521 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:45.869155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:45.879989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:45.880699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:45.882081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:45.883179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:45.975974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:45.986051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9e012177-db0c-4630-933f-c03a2bca7142 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.124021 Jun 24 09:15:45.997043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1365/2440] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:46.369419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:46.371070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:46.382221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:46.383420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:46.385543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:46.386249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:46.674682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:46.687740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:46.690578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:46.691918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eca8483e-2e2d-4c3d-a27a-d70ba0ff3cf7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.331506 Jun 24 09:15:46.693870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1076/2441] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:47.005285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:47.007192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:47.015267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:47.016394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:47.017602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:47.018095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:47.106995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:47.123437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-045de8a6-0f8e-48f6-a39e-4f2038888e11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.123004 Jun 24 09:15:47.124487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1366/2442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:47.366576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1636091843", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ee662f5-a7df-4f34-9688-a2bb7bae451c"}], "security_groups": [{"name": "tempest-securitygroup--275525631"}], "key_name": "tempest-keypair-114522886", "user_data": "}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:47.674750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] validate_networks() for [('0ee662f5-a7df-4f34-9688-a2bb7bae451c', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:15:47.712490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:47.714326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:47.724044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:47.724565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:47.726161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:47.726755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:47.983705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:48.006462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:48.009418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:48.011670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2074da2b-14a2-4a0c-832a-1c113cc1f42f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.304610 Jun 24 09:15:48.012415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1367/2443] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:48.140688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:48.141610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:48.154263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:15:48.154521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:15:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Jun 24 09:15:48.158067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:48.169275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:48.170593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:48.171047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:48.352187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:48.368128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f5020a4-05d9-445d-a2a0-1d059d7b9256 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.230770 Jun 24 09:15:48.368777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1368/2444] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:48.681923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:15:48.683592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:15:48.684460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:15:48.685096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:15:48.685769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:15:48.698973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:48.699828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:48.700935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:48.701595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:48.728383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:15:48.732484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Getting quotas for user fcaf1fc4ba1b4453a24260be3b908f0f and project 8bbf131dc8e64b818285edcfbcdb0b51. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:15:48.751553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:15:48.753871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:15:48.801625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f23580b2-ee20-4b95-be9b-2cc84f027af4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.443602 Jun 24 09:15:48.802729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1077/2445] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:15:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:15:48.815918 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8378aad0-4239-4c51-9adc-aa398bc52adf tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:48.818552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8378aad0-4239-4c51-9adc-aa398bc52adf tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:48.914011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8378aad0-4239-4c51-9adc-aa398bc52adf tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:48.922838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8378aad0-4239-4c51-9adc-aa398bc52adf tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1241 microversion: 2.1 time: 0.113033 Jun 24 09:15:48.923203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1369/2446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:48 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:49.030342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:49.030887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:49.037931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.038561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:49.039777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.040314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:49.219631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:49.230728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:49.233225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:49.234615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-42faeb3a-b68d-449a-9f5e-e20bbb6d95cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.208169 Jun 24 09:15:49.235758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1078/2447] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:49.387359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:49.388151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:49.398109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.398691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:49.399610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.400342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:49.465905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:49.474317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eeea6333-c1e8-4fb0-9ced-fb293113d7d7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.092250 Jun 24 09:15:49.474874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1370/2448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:49.941149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:49.941795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:49.947851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.948298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:49.949085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:49.949734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:50.012695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:50.021469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-045f49e1-21d6-46bc-a747-1816f290e7ec tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1245 microversion: 2.1 time: 0.085078 Jun 24 09:15:50.022116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1079/2449] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:49 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:50.253644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:50.254278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:50.260774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:50.261222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:50.262007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:50.262441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:50.393253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:50.402962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:50.404464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:50.405630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-61bddbd8-2ff9-47a0-aaf2-9e7613afcbfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.155976 Jun 24 09:15:50.406207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1371/2450] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:50.494278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:50.494810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:50.500767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:50.501209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:50.502003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:50.502430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:50.564994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:50.573543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b01f6a73-6d4e-48b5-ae6f-6c672312c834 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083164 Jun 24 09:15:50.574208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1080/2451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:51.038910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:51.039555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:51.045823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.046278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.047077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.047514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.119103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:51.126823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-851a8c59-fd88-4549-b4d0-1ea3ee1629ce tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1301 microversion: 2.1 time: 0.092505 Jun 24 09:15:51.127714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1372/2452] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:51 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:51.424009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:51.424710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:51.431817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.432264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.433038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.433478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.565702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:51.575131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:51.576665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:51.577892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e1aec2df-b4df-47d7-b1fa-8ce9873eb79b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.157813 Jun 24 09:15:51.578460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1081/2453] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:51.590465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:51.591079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:51.597355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.597835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.599246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:51.599682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:51.666243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:51.674252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2ec03e44-015a-4adf-aa28-3524ab904391 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087728 Jun 24 09:15:51.674819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1373/2454] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:52.143775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:52.144569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:52.151316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.151835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.152734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.153238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.290868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:52.299250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-46b4e271-0211-4d48-8b4c-3952711093cd tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.159245 Jun 24 09:15:52.299991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1082/2455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:52 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:52.478161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-d426509d-060e-4418-b987-40ecf56d8a5b req-ed01997b-ca2f-4491-9dc0-59db802c5544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4233f657-d7b2-4e34-b645-98352754eb77", "tag": "58467307-daf6-435b-a031-bfc5560c7c97"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:52.492029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-d426509d-060e-4418-b987-40ecf56d8a5b req-ed01997b-ca2f-4491-9dc0-59db802c5544 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.492523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-d426509d-060e-4418-b987-40ecf56d8a5b req-ed01997b-ca2f-4491-9dc0-59db802c5544 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.505636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-d426509d-060e-4418-b987-40ecf56d8a5b req-ed01997b-ca2f-4491-9dc0-59db802c5544 service nova] Creating event network-changed:58467307-daf6-435b-a031-bfc5560c7c97 for instance 4233f657-d7b2-4e34-b645-98352754eb77 on hv-cinder-78729 Jun 24 09:15:52.510609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-d426509d-060e-4418-b987-40ecf56d8a5b req-ed01997b-ca2f-4491-9dc0-59db802c5544 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040369 Jun 24 09:15:52.511225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1374/2456] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:15:52.596652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:52.597451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:52.605063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.605916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.606881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.607488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.699340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:52.700039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:52.706984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.707416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.708759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:52.709186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:52.766138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:52.775842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:52.777624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:52.779315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8ddddd4b-fbad-49f6-9534-8b09d4a7274a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.186816 Jun 24 09:15:52.783291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:52.789798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1083/2457] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:52.797431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6e6e1eb7-c5be-4b85-9b9d-2e2254171fcc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.109381 Jun 24 09:15:52.798760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1375/2458] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:53.316805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:53.318069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:53.324104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.324557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.325330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.325799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.450775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:53.458224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-25673099-7be5-42bb-87e8-b2e432a75f92 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.145341 Jun 24 09:15:53.458785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1084/2459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:53 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:53.798048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:53.798675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:53.806558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.807005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.807776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.808207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.814708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:53.815315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:53.821904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.822353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.823140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:53.823570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:53.905072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:53.914293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-07ef044e-ac96-42b4-a115-ccec0d297ca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.103312 Jun 24 09:15:53.914865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1085/2460] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:53.963230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:53.971606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:53.973115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:53.975054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-526ec4e6-acbe-46a9-96ce-424b7241e6e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.180920 Jun 24 09:15:53.975610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1376/2461] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:54.474894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:54.475508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:54.481550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:54.482030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:54.482786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:54.483229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:54.609586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:54.617813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f3df63c6-846f-4f0d-b8fc-f248ae963081 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.146729 Jun 24 09:15:54.618371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1086/2462] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:54 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:54.931804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:54.932476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:54.939000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:54.939450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:54.940215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:54.940649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:54.993036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:54.993627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:55.000302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:55.000754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:55.001524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:55.001995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:55.002387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:55.010319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a2a5d3d8-afd5-4cfd-abaf-c4f3f33be39c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082377 Jun 24 09:15:55.010883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1377/2463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:55.131702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:55.133917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:55.141499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:55.143129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:55.144293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7f673606-b709-4ef4-99e0-0a48f3320176 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.155771 Jun 24 09:15:55.144851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1087/2464] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:15:55.634599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:55.635207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:55.641227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:55.641684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:55.642453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:55.642881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:55.768896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:55.778768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-726ae7a7-cfee-44de-9e90-1edaeb96ee4b tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.148100 Jun 24 09:15:55.779335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1378/2465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:55 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:56.027270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:56.027873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:56.034420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.034863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.035879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.036301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.098973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:56.106805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d31b66c2-0778-4784-9545-329b8375b37c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083424 Jun 24 09:15:56.107358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1088/2466] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:56.163334 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:56.163941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:56.170449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.170892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.171676 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.172107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.299879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:56.309376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:56.310900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:56.312054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d6dabf78-1403-41ca-ae5a-ebca543ef719 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152922 Jun 24 09:15:56.312604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1379/2467] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:56.795659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:56.796293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:56.798149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:56.803449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.803893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.804643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:56.805072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:56.935687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:56.943709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-433966c9-1f3e-4e50-b6af-4de6776568d6 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.151857 Jun 24 09:15:56.944358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1089/2468] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:56 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:57.123741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:57.124347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:57.131379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.131827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:57.132585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.133025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:57.147724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:57.196548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:57.204512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fabdfa85-7a90-444e-af5a-e98e642bf19c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084882 Jun 24 09:15:57.205074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1380/2469] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:57.330827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:57.331429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:57.337867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.338313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:57.339058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.339613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:57.466503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:57.475480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:57.476988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:57.478187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7824b265-a61a-4ab4-a8c5-1bae1706598c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151301 Jun 24 09:15:57.478746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1090/2470] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:57.960972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:57.961578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:57.967552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.967994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:57.968737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:57.969167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:58.096777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:58.104051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-09364966-bf4d-4b27-9b0f-6e3fa52105a0 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.147607 Jun 24 09:15:58.104605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1381/2471] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:57 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:58.221173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:58.221752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:58.227724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:58.228177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:58.228939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:58.229383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:58.291152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:58.298976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-12367be0-7967-42c9-99e9-0343e2886520 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081704 Jun 24 09:15:58.299542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1091/2472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:58.497678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:58.498224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:58.505460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:58.505943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:58.506707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:58.507243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:58.636630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:58.644919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:58.646964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:58.648117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8f2d3141-1713-4f66-9351-4750d6d89709 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.154468 Jun 24 09:15:58.648671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1382/2473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:15:58.994873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:58.996046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=10 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:59.121440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:59.122077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:59.123887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:59.129566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.130050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.130805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.131419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.175623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-e710469d-692b-4dcf-9389-b8c8ea17cb7f req-6f68c432-a72f-4185-aa11-7d5c6ed023ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4233f657-d7b2-4e34-b645-98352754eb77", "name": "network-vif-plugged", "status": "completed", "tag": "58467307-daf6-435b-a031-bfc5560c7c97"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:15:59.183698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-e710469d-692b-4dcf-9389-b8c8ea17cb7f req-6f68c432-a72f-4185-aa11-7d5c6ed023ba service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.184140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-e710469d-692b-4dcf-9389-b8c8ea17cb7f req-6f68c432-a72f-4185-aa11-7d5c6ed023ba service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.195359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-e710469d-692b-4dcf-9389-b8c8ea17cb7f req-6f68c432-a72f-4185-aa11-7d5c6ed023ba service nova] Creating event network-vif-plugged:58467307-daf6-435b-a031-bfc5560c7c97 for instance 4233f657-d7b2-4e34-b645-98352754eb77 on hv-cinder-78729 Jun 24 09:15:59.200374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-e710469d-692b-4dcf-9389-b8c8ea17cb7f req-6f68c432-a72f-4185-aa11-7d5c6ed023ba service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210310 Jun 24 09:15:59.201141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1092/2474] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:15:59.264995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:59.273956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d37e6e6f-2d61-473b-9446-5ca575b64d50 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.156576 Jun 24 09:15:59.274531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1383/2475] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:59 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:15:59.317910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:59.318613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:59.325759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.326212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.327031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.327467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.396054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:59.404546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c959ebde-a66b-49bd-aea5-cdb7e86db5fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.091781 Jun 24 09:15:59.405141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1093/2476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:15:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:15:59.666730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:15:59.667272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:15:59.673798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.674246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.674997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:15:59.675430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:15:59.801997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:59.810295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:59.811786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:15:59.812941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-58fff5a6-99d0-4674-9efe-a88638ee581f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150156 Jun 24 09:15:59.813489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1384/2477] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:15:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:00.290525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:00.291097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:00.297503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.297995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.298761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.299199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.422092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:00.422504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:00.422699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:00.429186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.429630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.430435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.430618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c2d8f255-8a26-4a37-93a8-67b54cc97522 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1366 microversion: 2.1 time: 0.143982 Jun 24 09:16:00.430864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.431192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1094/2478] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:00 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:00.493523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:00.501397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a2930520-93bc-4ee6-91a0-12afd58ebbff tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083156 Jun 24 09:16:00.501988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1385/2479] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:00.831503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:00.832029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:00.838692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.839143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.839900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:00.840335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:00.973808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:00.982275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:00.983755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:00.984910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-13b6626f-ce82-4db8-b213-6979678afd65 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.157466 Jun 24 09:16:00.985467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1095/2480] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:01.447398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:01.447960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:01.454458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.454908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.455671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.456146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.518736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:01.519378 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:01.526705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.527166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.527943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.528381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.604475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:01.612371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:01.612751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c3d44b56-bb15-4300-80f5-9a595cf00122 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.097815 Jun 24 09:16:01.613337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1096/2481] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:01.620609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fe541cd8-e9f5-4263-9589-5c32a1c8027e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1557 microversion: 2.1 time: 0.176839 Jun 24 09:16:01.621791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1386/2482] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:01 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:01.641060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:01.641557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:01.648058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.648506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.649263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:01.649721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:01.725388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09fb0d0b-3eae-450f-977d-30eb1bd7b3c7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088364 Jun 24 09:16:01.726052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1097/2483] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 09:16:01 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:16:02.003970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:02.004535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:02.010432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:02.010877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:02.011625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:02.012053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:02.242573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:02.251060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:02.252490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:02.253677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a37ed784-68b3-4fbb-8407-81a1fb9807ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.253697 Jun 24 09:16:02.254300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1387/2484] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:02.630914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:02.631534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:02.638066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:02.638520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:02.639302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:02.639745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:02.895054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:02.903319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e54d0ed1-2173-48a0-9b22-dbb9daa69a2d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.277339 Jun 24 09:16:02.905250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1098/2485] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:03.007021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-6fd93314-748b-4762-b254-f4abae6e79ca req-78c38fe6-f49a-4271-a92e-b63a7fba22e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4233f657-d7b2-4e34-b645-98352754eb77", "tag": "58467307-daf6-435b-a031-bfc5560c7c97"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:16:03.014998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6fd93314-748b-4762-b254-f4abae6e79ca req-78c38fe6-f49a-4271-a92e-b63a7fba22e9 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:03.015444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6fd93314-748b-4762-b254-f4abae6e79ca req-78c38fe6-f49a-4271-a92e-b63a7fba22e9 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:03.027123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-6fd93314-748b-4762-b254-f4abae6e79ca req-78c38fe6-f49a-4271-a92e-b63a7fba22e9 service nova] Creating event network-changed:58467307-daf6-435b-a031-bfc5560c7c97 for instance 4233f657-d7b2-4e34-b645-98352754eb77 on hv-cinder-78729 Jun 24 09:16:03.032192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-6fd93314-748b-4762-b254-f4abae6e79ca req-78c38fe6-f49a-4271-a92e-b63a7fba22e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088339 Jun 24 09:16:03.032784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1388/2486] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:16:03.272306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:03.272927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:03.279214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:03.279659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:03.280428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:03.280859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:03.424715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:03.434635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:03.436284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:03.437581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c78c4d08-62d5-4d88-9642-d00700b6a2a4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.169539 Jun 24 09:16:03.438724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1099/2487] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:03.922140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:03.922835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:03.930040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:03.930490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:03.931242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:03.931672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:03.999534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:04.008569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d324c090-63cb-4469-87ee-b8857cf35d16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090636 Jun 24 09:16:04.009299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1389/2488] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:04.456079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:04.456684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:04.463150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:04.463593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:04.464341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:04.464770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:04.588773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:04.597174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:04.598710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:04.599869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f9717712-8b7b-460b-b6c7-3c9a29607bfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147644 Jun 24 09:16:04.600424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1100/2489] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:05.025440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:05.026061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:05.032438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:05.032889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:05.033638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:05.034091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:05.099328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:05.107293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3317aa2b-9529-4ccd-9685-a8f7cde0a7a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085675 Jun 24 09:16:05.107855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1390/2490] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:05.618147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:05.618754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:05.628790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:05.629235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:05.630511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:05.630948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:05.755684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:05.763991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:05.765487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:05.766677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c060b744-e0b8-495b-a518-79d349773942 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152487 Jun 24 09:16:05.767236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1101/2491] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:06.124210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:06.124815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:06.127241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:06.132538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:06.132981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:06.133759 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:06.134189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:06.194151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:06.201878 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ff3a4cdd-4a00-4462-86dd-bfb665204ca2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081587 Jun 24 09:16:06.202428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1391/2492] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:06.785227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:06.786116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:06.792638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:06.793085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:06.798119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:06.798557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:06.931007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:06.939319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:06.940815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:06.944120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6b5aec16-f7be-4b77-9c01-3a90bc5477d2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.160615 Jun 24 09:16:06.944120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1102/2493] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:07.219473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:07.220085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:07.227129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:07.227579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:07.228338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:07.228772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:07.287389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:07.295137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f264b11-1717-4b60-a623-9bab98eebd07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079811 Jun 24 09:16:07.295695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1392/2494] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:07.961265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:07.961898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:07.968752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:07.969155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:07.969961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:07.970398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:08.095498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:08.104508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:08.106041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:08.107201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-92e5ce9e-861a-4961-bcb6-9e58fefdd141 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150232 Jun 24 09:16:08.107765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1103/2495] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:08.312554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:08.313159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:08.319669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:08.320114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:08.320859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:08.321293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:08.383343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:08.391189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cb840c61-c1b2-4b22-b67e-711b945c049d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082495 Jun 24 09:16:08.391739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1393/2496] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:09.125516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:09.126173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:09.132762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:09.133207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:09.133996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:09.134426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:09.262853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:09.271996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:09.273474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:09.274658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-59cfdd4e-0774-4abf-97fe-5983a4b88eb4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.153118 Jun 24 09:16:09.275207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1104/2497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:09.408341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:09.408950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:09.415860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:09.416310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:09.417070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:09.417506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:09.477089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:09.484890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9cea126b-83ce-497a-af55-75508129de23 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080464 Jun 24 09:16:09.485449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1394/2498] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:10.292584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:10.293201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:10.300229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:10.300689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:10.301458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:10.301929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:10.316706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:10.430697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:10.438918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:10.440398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:10.441542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-93d3e6d3-20b0-486c-ac5e-e3eeca6c1140 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152890 Jun 24 09:16:10.442691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1105/2499] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:10.501284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:10.501922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:10.508853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:10.509295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:10.510072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:10.510499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:10.569931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:10.577691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-453b4d58-a825-49ea-b6b3-b10298f144ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080161 Jun 24 09:16:10.578257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1395/2500] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:11.460834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:11.461440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:11.467914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:11.468363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:11.469129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:11.469568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:11.594212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:11.594828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:11.595492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:11.601410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:11.601895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:11.602666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:11.603103 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:11.604234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:11.605746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:11.606910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-37c7d18c-160e-4f3c-bd41-28ab6078961d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150592 Jun 24 09:16:11.607462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1106/2501] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:11.669785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:11.677591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4ee19c61-ab37-400c-a1ae-d702d684373a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087207 Jun 24 09:16:11.678175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1396/2502] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:12.625649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:12.626382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:12.632885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:12.633338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:12.634135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:12.634576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:12.694584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:12.695294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:12.701747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:12.702197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:12.702951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:12.703388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:12.772630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:12.775910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:12.780814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-934d0781-3d0c-4ee8-8b1b-9c69aab367e9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090330 Jun 24 09:16:12.781372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1397/2503] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:12.787310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:12.795608 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:12.797086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:12.798267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-636a5e96-3b31-46b6-89e7-54123d0751e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.176586 Jun 24 09:16:12.798812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1107/2504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:13.798495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:13.799344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:13.806574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:13.807020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:13.807768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:13.808194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:13.816428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:13.817031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:13.823693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:13.824149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:13.824923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:13.825394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:13.870317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:13.878575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a70f5a33-ede8-4ba7-a97c-b1d79a49b136 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084500 Jun 24 09:16:13.879152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1398/2505] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:13.975628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:13.983987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:13.985475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:13.986672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9da74b51-b5fb-4328-aa3f-cce7fd2e165d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.174193 Jun 24 09:16:13.987232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1108/2506] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:16:14.895567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:14.896116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:14.902644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:14.903094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:14.903853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:14.904289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:14.963716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:14.971628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a083a289-dc5c-415c-a243-2f1e0b313361 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080055 Jun 24 09:16:14.972193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1399/2507] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:15.005383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:15.006021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:15.012504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:15.012951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:15.013738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:15.014175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:15.143808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:15.152277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:15.153746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:15.154910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5d2371d2-9c9b-4e54-8f08-2fbac7cc0174 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.153973 Jun 24 09:16:15.155459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1109/2508] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:15.988249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:15.989378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:15.995832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:15.996283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:15.997038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:15.997472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:16.056581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:16.064409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b79eccc-42c1-4cae-814e-ec3a5a7b2df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080095 Jun 24 09:16:16.064973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1400/2509] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:16.172869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:16.173523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:16.180678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:16.181119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:16.182170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:16.182606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:16.313604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:16.321935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:16.323420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:16.324564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5a8502b6-d5bc-4453-b784-5e6a0f6a84a5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.156029 Jun 24 09:16:16.325120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1110/2510] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:17.081277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:17.081924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:17.088888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:17.089338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:17.090124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:17.090560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:17.150290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:17.158016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-92b11c47-2737-492c-ae9a-4e38eb8c1a89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080557 Jun 24 09:16:17.158582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1401/2511] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:17.343237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:17.343786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:17.350843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:17.351286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:17.352313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:17.352748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:17.479828 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:17.488064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:17.489584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:17.490752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f7327f42-ce1f-42bd-87bf-c5c37faa2051 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151432 Jun 24 09:16:17.491315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1111/2512] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:18.175679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:18.176333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:18.183399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:18.183847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:18.184601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:18.185035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:18.243956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:18.251760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d7a33b29-3f45-46a4-8b39-cad74b124739 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080004 Jun 24 09:16:18.252313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1402/2513] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:18.508931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:18.509501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:18.516284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:18.516728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:18.517490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:18.517960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:18.649485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:18.657867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:18.659368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:18.660529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb1eb07e-70a1-4896-9e90-e0a2cc10c967 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.155622 Jun 24 09:16:18.661356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1112/2514] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:19.268272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:19.269042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:19.276106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:19.276563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:19.277325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:19.277793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:19.337262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:19.345291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9a278112-b99f-4208-8146-f3be13c8c1f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080910 Jun 24 09:16:19.345890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1403/2515] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:19.680134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:19.680746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:19.686884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:19.687336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:19.688093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:19.688527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:19.815333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:19.824025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:19.825570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:19.826829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-75cf8480-cfb1-4fd4-80a8-2858a9d59c73 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151398 Jun 24 09:16:19.827394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1113/2516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:20.367266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:20.368017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:20.374461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:20.375092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:20.375677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:20.376112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:20.436350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:20.444237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86a48025-5fae-4bae-be87-cd53ea2c336d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081372 Jun 24 09:16:20.444802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1404/2517] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:20.844315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:20.844951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:20.851372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:20.851815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:20.852569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:20.852997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:20.985055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:20.993971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:20.995481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:20.996648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fa455c5a-de73-4c3f-a31a-fc7fffc0811e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.156226 Jun 24 09:16:20.997214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1114/2518] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:21.460876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:21.461488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:21.468008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:21.468455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:21.469208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:21.469640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:21.529315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:21.537979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e1d007ce-22bb-453d-89c7-2701edc01058 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080985 Jun 24 09:16:21.538535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1405/2519] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:22.023080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:22.023684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:22.030182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:22.030623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:22.031374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:22.031804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:22.162407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:22.170658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:22.172131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:22.173279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5ae2562d-87b6-434d-a5f3-5dda40e6fbae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.154732 Jun 24 09:16:22.173862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1115/2520] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:22.555262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:22.555877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:22.562364 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:22.562813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:22.563573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:22.564010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:22.623510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:22.632083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62422208-0018-47dd-865c-f50b3e7efd8e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081169 Jun 24 09:16:22.632649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1406/2521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:23.191560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:23.192168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:23.198707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:23.199157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:23.199912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:23.200346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:23.328128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:23.336947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:23.338524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:23.339711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ce05df33-8067-4a67-a261-5d26a827a8fd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152088 Jun 24 09:16:23.340271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1116/2522] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:23.649441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:23.650072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:23.656475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:23.656917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:23.657682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:23.658114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:23.719824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:23.727848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b8cb9444-dfea-4776-913b-fa909137a2b9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083331 Jun 24 09:16:23.728414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1407/2523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:24.358498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:24.359472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:24.366227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:24.366675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:24.367427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:24.367891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:24.498019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:24.506373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:24.507852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:24.508989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c38fae2b-172e-4a76-a216-e0c5b8e885fe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.154392 Jun 24 09:16:24.509544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1117/2524] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:24.744295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:24.744909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:24.751416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:24.751868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:24.752630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:24.753068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:24.812656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:24.820568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b645eb1-bdc9-4814-8a23-c745e0eb6ef8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080145 Jun 24 09:16:24.821136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1408/2525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:25.527311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:25.527979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:25.534335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:25.534779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:25.535534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:25.535964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:25.664369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:25.672687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:25.674202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:25.675345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f504f8b3-1324-4160-b886-78b1f9bd5984 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151926 Jun 24 09:16:25.675931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1118/2526] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:25.836892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:25.837430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:25.843855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:25.844303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:25.845056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:25.845489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:25.904743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:25.912828 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2751600f-c213-4279-a220-04ba64b1b1fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080493 Jun 24 09:16:25.913387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1409/2527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:26.694046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:26.694658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:26.701083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:26.701532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:26.702322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:26.702758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:26.826646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:26.835450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:26.836937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:26.838115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ae3faad4-6e4a-476c-994f-eca77ae9593b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147997 Jun 24 09:16:26.838678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1119/2528] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:26.929190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:26.929763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:26.936234 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:26.936684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:26.937437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:26.937899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:26.996796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:27.004613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8a98b020-76bb-4806-a5fd-7688b7d85c91 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079375 Jun 24 09:16:27.005220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1410/2529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:27.856956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:27.857565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:27.859934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=62 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:27.865855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:27.866246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:27.867006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:27.867441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:27.995574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:28.003833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:28.005332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:28.006529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9069fa29-ff21-424b-8e4a-ab21b3c68e67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.153498 Jun 24 09:16:28.007082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1120/2530] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:28.021969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:28.022585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:28.028980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:28.029430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:28.030230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:28.030666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:28.090131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:28.097870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-31f2a422-1656-43d2-a336-f0d3371a8ec1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080141 Jun 24 09:16:28.098438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1411/2531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:29.025653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:29.026308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:29.032900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:29.033354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:29.034151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:29.034591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:29.115774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:29.116374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:29.122932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:29.123375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:29.124127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:29.124557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:29.173978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:29.182950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:29.184474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:29.185626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a5bf5c80-3c41-4bd7-9424-e27824046d46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.163946 Jun 24 09:16:29.186215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1121/2532] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:29.189681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:29.198169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a3a3b917-6443-4272-b7c7-3123cacb39fe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086832 Jun 24 09:16:29.198724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1412/2533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:30.204230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:30.204875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:30.212078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:30.212525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:30.213286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:30.213763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:30.215145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:30.215763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:30.216318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:30.222618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:30.223075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:30.223845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:30.224288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:30.305068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:30.313104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ec6de5da-8459-4f72-acd9-2be06c2418fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.101777 Jun 24 09:16:30.313700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1413/2534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:30.367230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:30.375603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:30.377090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:30.378283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1c1430bc-209e-4844-9bc1-bf65ee48d35a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.177931 Jun 24 09:16:30.378839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1122/2535] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:31.330289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:31.330900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:31.337925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:31.338372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:31.339385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:31.339821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:31.355339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:31.396854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:31.397441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:31.403973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:31.404160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:31.404669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:31.405533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:31.406052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:31.412645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c40e988e-028d-42ea-965e-d94d83a8bfae tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086189 Jun 24 09:16:31.413209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1414/2536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:31.530959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:31.540150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:31.541684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:31.542847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-70f81310-9033-4674-beb4-37ed7226c5c0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150460 Jun 24 09:16:31.543401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1123/2537] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:16:32.429758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:32.430380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:32.437966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:32.438397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:32.439157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:32.439595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:32.498595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:32.506407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3359364-2f55-4de5-b587-a6ab644ed33d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080593 Jun 24 09:16:32.506964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1415/2538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:32.560762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:32.561363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:32.567752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:32.568196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:32.568948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:32.569384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:32.697114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:32.705304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:32.706824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:32.707993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dc323e15-f7af-4d21-8d6f-442ffa300bb0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151069 Jun 24 09:16:32.709497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1124/2539] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:33.523657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:33.524303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:33.530783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:33.531239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:33.532028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:33.532618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:33.593314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:33.601265 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87ed051b-353b-489d-a943-7e696cee69e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082098 Jun 24 09:16:33.601864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1416/2540] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:33.727669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:33.728272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:33.734753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:33.735197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:33.735955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:33.736385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:33.862744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:33.871554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:33.873034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:33.874217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-26c66e37-74a9-4cbf-833b-f898a6defe58 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150481 Jun 24 09:16:33.874769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1125/2541] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:34.618043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:34.618653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:34.625275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:34.625754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:34.626514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:34.626949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:34.695427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:34.703434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7245593b-c112-4fc1-aea9-428ff466ee51 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.089324 Jun 24 09:16:34.704030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1417/2542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:34.893113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:34.893679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:34.901110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:34.901555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:34.902410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:34.902851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:35.041352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:35.053590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:35.055510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:35.056698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7369b291-3a1d-4e68-b35a-1e34c4df5a38 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.167684 Jun 24 09:16:35.057266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1126/2543] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:35.720434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:35.721157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:35.728198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:35.728647 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:35.729400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:35.729882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:35.789831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:35.797678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-93f47d90-1ee7-4188-9d16-602350177c9e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081126 Jun 24 09:16:35.798240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1418/2544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:36.075526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:36.076120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:36.082653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:36.083614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:36.084370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:36.084805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:36.211990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:36.221476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:36.223045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:36.224431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-946f0a16-6ab4-4837-95a5-01f3c1af4487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152864 Jun 24 09:16:36.224998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1127/2545] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:36.815214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:36.815827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:36.818779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:36.824133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:36.824583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:36.825335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:36.825800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:36.884709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:36.892540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-09903a5e-d3b2-49f9-8c77-1909636046cf tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081239 Jun 24 09:16:36.893102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1419/2546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:37.243542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:37.244146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:37.250599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:37.251041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:37.251794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:37.252221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:37.378969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:37.387196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:37.388685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:37.389873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-253f9a6b-8e8b-4267-96cd-d36379ce5a48 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150865 Jun 24 09:16:37.390431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1128/2547] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:37.909088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:37.909764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:37.916487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:37.916933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:37.917694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:37.918129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:37.981863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:37.992272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-00074198-ac5e-4534-87de-0f1e3bb2ec32 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086907 Jun 24 09:16:37.992902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1420/2548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:38.408582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:38.409200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:38.416189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:38.416667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:38.417425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:38.417887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:38.543540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:38.551949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:38.553431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:38.554605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-247c5b3b-bf9e-41a6-9db4-d1cb87eb462d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.149927 Jun 24 09:16:38.555164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1129/2549] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:39.010694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:39.011326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:39.017844 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:39.018287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:39.019032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:39.019459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:39.078803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:39.086716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e6d1dd88-b4f5-46b3-b585-9bbad64be8a8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081837 Jun 24 09:16:39.087275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1421/2550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:39.572347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:39.572958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:39.579455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:39.579900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:39.580651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:39.581086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:39.712554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:39.721070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:39.722602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:39.724437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0a063817-4ff7-4f41-9275-ab2dc6f0977a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.155348 Jun 24 09:16:39.724998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1130/2551] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:40.102649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:40.103270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:40.109768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:40.110225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:40.110991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:40.111428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:40.171842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:40.179741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e11e1391-e66f-471b-ba59-31509aac9f97 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080967 Jun 24 09:16:40.180308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1422/2552] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:40.741902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:40.742522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:40.749029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:40.749480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:40.750278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:40.750721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:40.875101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:40.883960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:40.885473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:40.886675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a3e724fd-6117-448e-a977-4ee9ee7075eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.148698 Jun 24 09:16:40.887238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1131/2553] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:41.196887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:41.197527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:41.204087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:41.204534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:41.205279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:41.205736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:41.267494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:41.275474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d1b5197-0e60-435b-923b-e343af971de8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083021 Jun 24 09:16:41.276031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1423/2554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:41.905804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:41.906426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:41.913545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:41.914026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:41.914799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:41.915241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:42.041991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:42.050576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:42.052088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:42.053229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-879a6368-fa11-4d71-a8fd-81a3cef30437 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151401 Jun 24 09:16:42.053804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1132/2555] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:42.292583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:42.293152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:42.299848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:42.300290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:42.301039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:42.301467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:42.360512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:42.368329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-709ee796-1670-41b6-866e-1f900161fa92 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079729 Jun 24 09:16:42.368887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1424/2556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:43.071510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:43.072135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:43.078654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:43.079106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:43.079865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:43.080302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:43.208627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:43.217576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:43.219102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:43.220264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d60535fc-9664-4f52-8841-437b7d3604cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152637 Jun 24 09:16:43.220830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1133/2557] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:43.385066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:43.385622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:43.391722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:43.392165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:43.392913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:43.393341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:43.452535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:43.461030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a10f82e8-381e-42ae-a162-7e1ec3823cb9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079899 Jun 24 09:16:43.461583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1425/2558] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:44.238607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:44.239247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:44.245956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:44.246445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:44.247215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:44.247654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:44.371953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:44.380700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:44.382228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:44.383425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aa436045-3a55-4156-885f-ee7973e871ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.148777 Jun 24 09:16:44.383976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1134/2559] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:44.477492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:44.478124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:44.484561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:44.485007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:44.485784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:44.486215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:44.549246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:44.557133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f806395-f165-4fc5-acbe-033ea28b37fc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083505 Jun 24 09:16:44.557710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1426/2560] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:45.401778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:45.402338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:45.408704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:45.409151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:45.409944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:45.410381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:45.537074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:45.545863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:45.547395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:45.548627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-610b3e5c-0829-4abb-8e61-a37296f56a67 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150931 Jun 24 09:16:45.549189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1135/2561] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:45.573568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:45.574197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:45.580548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:45.580992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:45.581762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:45.582197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:45.642704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:45.651130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-492f1a66-0118-41e6-93ee-c5f48350bd16 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081394 Jun 24 09:16:45.651694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1427/2562] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:46.566799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:46.568084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:46.574500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:46.574948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:46.575705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:46.576138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:46.668236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:46.668855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:46.675351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:46.675806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:46.676573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:46.677561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:46.704436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:46.712915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:46.714481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:46.717730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a040579f-02c0-406b-9573-2f14b6e8febc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152746 Jun 24 09:16:46.717730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1136/2563] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:46.736671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:46.745254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e469a34f-7d80-40a4-9aa5-bcc42749f08f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080929 Jun 24 09:16:46.745842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1428/2564] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:47.735559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:47.736328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:47.742760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:47.743204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:47.743953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:47.744377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:47.761879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:47.762493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:47.768989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:47.769434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:47.770239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:47.771286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:47.844395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:47.852296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a154a041-65d3-4e3b-92f8-a1868d0d8f6b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.094332 Jun 24 09:16:47.852864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1429/2565] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:47.903827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:47.912410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:47.913919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:47.915063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-72a38ca3-1467-4682-8b06-a37e06447b46 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.183412 Jun 24 09:16:47.915612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1137/2566] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:48.868871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:48.869419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:48.875901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:48.876348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:48.877101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:48.877536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:48.933018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:48.933615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:48.936757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:48.940146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:48.940672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:48.941511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:48.941981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:48.945710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6b725b06-51a0-4568-8cd3-5f6de3b6e995 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080748 Jun 24 09:16:48.946748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1430/2567] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:49.073470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:49.075706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:49.083620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:49.085121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:49.086314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7839c85-4611-441c-802e-4c00fd72eaac tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.157224 Jun 24 09:16:49.087223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1138/2568] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:16:49.962473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:49.963010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:49.969430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:49.969910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:49.970671 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:49.971101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:49.974474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:50.034856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:50.043517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1ee9cbc9-e96b-45b5-ac70-9e55856d0c29 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085025 Jun 24 09:16:50.044077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1431/2569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:50.105138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:50.105767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:50.111664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:50.112115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:50.112859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:50.113285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:50.237301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:50.245583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:50.247095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:50.248276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7e71a83-e5f3-4280-9bae-0fb4843ca7d3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147380 Jun 24 09:16:50.248833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1139/2570] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:51.062121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:51.062815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:51.071024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:51.071468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:51.072257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:51.073012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:51.133031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:51.141260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b64b0ca4-ee34-40e7-9588-7b71d16d2cd5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083210 Jun 24 09:16:51.141849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1432/2571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:51.266573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:51.267216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:51.273810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:51.274261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:51.275022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:51.275458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:51.408338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:51.417231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:51.418753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:51.419908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-226b2d79-9212-4f85-9987-904eb7c9e913 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.157262 Jun 24 09:16:51.420463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1140/2572] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:52.157999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:52.158604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:52.166214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:52.166698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:52.167468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:52.167907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:52.227704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:52.235530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f93ff302-6126-4221-bdc1-7336b9bb88d4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081471 Jun 24 09:16:52.236093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1433/2573] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:52.438758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:52.439313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:52.445967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:52.446416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:52.447175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:52.447672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:52.574313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:52.582560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:52.584555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:52.585745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9ac45761-6050-4bd3-b3fd-f66a638f89b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150951 Jun 24 09:16:52.586307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1141/2574] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:53.252961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:53.253571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:53.260684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:53.261136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:53.261948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:53.262383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:53.325074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:53.333027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-64edd822-a7a0-4c68-9fd5-ba525d33c0f1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083969 Jun 24 09:16:53.333619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1434/2575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:53.604058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:53.604697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:53.611540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:53.611663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:53.612452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:53.612881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:53.741324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:53.749862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:53.751354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:53.752514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b7a481e5-e465-4ffb-ab05-df4ff0d7d6eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152429 Jun 24 09:16:53.753074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1142/2576] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:54.350322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:54.350934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:54.357617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:54.358092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:54.358845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:54.359272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:54.422604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:54.431051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d89e2988-195f-4cc4-8852-819597affa0b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085116 Jun 24 09:16:54.431607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1435/2577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:54.771800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:54.772404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:54.778834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:54.779283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:54.780046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:54.780483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:54.907492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:54.916476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:54.917997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:54.919158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c876ad0d-1878-4ead-a5b0-0f9b689807e8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151806 Jun 24 09:16:54.919722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1143/2578] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:55.448305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:55.448892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:55.455297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:55.455740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:55.456493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:55.456923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:55.516806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:55.524539 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b0e92790-c4d2-46e8-b075-278b91d1c8f5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080111 Jun 24 09:16:55.525099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1436/2579] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:55.937603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:55.938249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:55.944720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:55.945169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:55.945956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:55.946395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:56.069979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:56.078288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:56.079797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:56.080960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-616ce832-9371-4c30-86ce-cf35c24cb163 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147321 Jun 24 09:16:56.081522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1144/2580] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:56.541242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:56.541913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:56.548363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:56.548811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:56.549563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:56.550026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:56.613749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:56.621744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-343ba436-bcf2-441d-8095-20ab6e1a7d4d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084321 Jun 24 09:16:56.622313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1437/2581] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:57.100016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:57.100630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:57.107448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:57.107896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:57.108648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:57.109080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:57.231896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:57.240691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:57.242190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:57.243428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-64bcaeeb-dfbe-423a-a60b-8e9e004ff3e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147409 Jun 24 09:16:57.243984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1145/2582] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:57.638189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:57.638803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:57.645313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:57.645797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:57.646557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:57.646988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:57.706377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:57.714762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-65f254c8-6123-436d-8c03-1b61461342e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080431 Jun 24 09:16:57.715320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1438/2583] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:16:58.262407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:58.263055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:58.265482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=52 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:58.270814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:58.271268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:58.272032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:58.272471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:58.399160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:58.407441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:58.408965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:58.410128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cf397a9c-fbd4-4c19-abac-7fc331481fde tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151654 Jun 24 09:16:58.410677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1146/2584] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:58.731903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:58.732512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:58.739066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:58.739510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:58.740259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:58.740711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:58.802070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:58.810933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37e9216c-d9ce-492b-8750-349362254e55 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082843 Jun 24 09:16:58.811505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1439/2585] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:16:59.429716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:59.430295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:59.439051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:59.439511 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:59.440293 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:59.440736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:59.574488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:59.582927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:59.584433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:59.586198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e7f2aaca-4065-43ff-87e0-b55bf2275369 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.160984 Jun 24 09:16:59.586796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1147/2586] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:16:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:16:59.827472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:16:59.828089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:16:59.834565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:59.835021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:59.835786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:16:59.836227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:16:59.899574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:16:59.907870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-acabd49f-8f24-472c-a246-933032c66486 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084263 Jun 24 09:16:59.908443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1440/2587] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:16:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:00.604531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:00.605151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:00.613938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:00.614565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:00.615667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:00.616283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:00.759968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:00.769965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:00.772269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:00.774800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a47d67c8-8046-4081-b518-164b66aefc27 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.173964 Jun 24 09:17:00.775732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1148/2588] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:00.924303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:00.924906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:00.931376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:00.931830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:00.932587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:00.933025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:00.992793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:01.001166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3dd74fae-02ba-430a-b788-3c3ce149b0a0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080706 Jun 24 09:17:01.001782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1441/2589] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:01.799003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:01.799601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:01.806838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:01.807294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:01.808055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:01.808496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:01.935305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:01.943812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:01.945326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:01.946519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a233e153-ecda-46bf-be8e-3b1e650bf578 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151474 Jun 24 09:17:01.947082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1149/2590] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:02.018845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:02.019459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:02.026651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:02.027108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:02.027873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:02.028312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:02.095166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:02.103635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-31cf0c2f-78c0-4b56-acd8-83f10ea58723 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088663 Jun 24 09:17:02.104202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1442/2591] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:02.965208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:02.965794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:02.972201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:02.972649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:02.973410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:02.973878 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:03.103722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:03.112013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:03.113523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:03.114691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-309db863-bd79-4643-b012-4a5cfa52776d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.153635 Jun 24 09:17:03.115243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1150/2592] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:03.120044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:03.120659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:03.127459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:03.128167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:03.128938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:03.129378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:03.197121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:03.205137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-708012a3-4569-48f3-b918-27d7802cc347 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.089425 Jun 24 09:17:03.205726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1443/2593] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:04.135930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:04.136543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:04.143015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:04.143465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:04.144221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:04.144654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:04.224241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:04.224861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:04.231474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:04.231948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:04.232842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:04.233158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:04.282391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:04.292715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:04.294250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:04.295422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-56c2b4cf-0b79-4b52-9bd8-b5e8b86fc94d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.163871 Jun 24 09:17:04.296670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1151/2594] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:04.298000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:04.306718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6ce4adf2-7f5f-4083-bd1c-f564867d7f11 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086261 Jun 24 09:17:04.307306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1444/2595] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:05.314669 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:05.315275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:05.321825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:05.322278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:05.323047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:05.323166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:05.323565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:05.323718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:05.330356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:05.330842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:05.331610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:05.332046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:05.410716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:05.419422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-82367c1e-b364-44be-b10e-073c5b723052 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.100051 Jun 24 09:17:05.420194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1445/2596] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:05.478798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:05.487118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:05.488597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:05.489774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9d614fda-ee36-439a-af20-8fb6dd420625 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.179016 Jun 24 09:17:05.490332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1152/2597] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:06.436362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:06.437004 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:06.443534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:06.443980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:06.445268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:06.445725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:06.508639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:06.509134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:06.509275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:06.515804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:06.516256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:06.517027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:06.517138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5793409e-88db-49a5-956b-1d80fdb11262 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084660 Jun 24 09:17:06.517461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:06.518019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1446/2598] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:06.645147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:06.653435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:06.654971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:06.656167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09d053fb-b6d2-4f81-9c7b-9be23f4e0d68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152129 Jun 24 09:17:06.656726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1153/2599] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:17:07.534139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:07.534749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:07.537281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:07.543300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:07.543745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:07.544498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:07.544929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:07.607559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:07.609765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:07.617026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c3541493-138e-4d92-a0de-532a53fd397a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086441 Jun 24 09:17:07.617588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1447/2600] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:07.674468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:07.675062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:07.681497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:07.681977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:07.682735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:07.683167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:07.808323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:07.816516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:07.818061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:07.819779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-15dce321-5aab-48e5-be35-0c746a09a169 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.148664 Jun 24 09:17:07.820340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1154/2601] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:08.633333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:08.633974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:08.640489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:08.640945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:08.641729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:08.642170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:08.701955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:08.710470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dea2ddfc-5465-4b16-9d80-462a1afae30d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080805 Jun 24 09:17:08.711042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1448/2602] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:08.838049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:08.838710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:08.847109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:08.847556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:08.848318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:08.848777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:08.866473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:08.981982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:08.990322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:08.992672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:08.993862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb5f2d32-d547-4860-89b6-f11caac69211 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.159833 Jun 24 09:17:08.994427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1155/2603] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:09.782070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:09.782679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:09.789974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:09.790428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:09.791182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:09.791613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:09.853453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:09.861485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46d1658a-f621-4259-8738-a63171e6bb19 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083317 Jun 24 09:17:09.862012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1449/2604] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:10.012679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:10.013272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:10.019614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:10.020062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:10.020815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:10.021246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:10.153990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:10.162692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:10.164227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:10.165523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8ef2b9be-461c-4513-9c78-837fe2bd2ce5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.156799 Jun 24 09:17:10.166119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1156/2605] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:10.878596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:10.879202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:10.886221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:10.886666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:10.887412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:10.887837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:10.950063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:10.958011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-97dba3b4-3838-4f5e-991d-59d4d6b2ffbb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083294 Jun 24 09:17:10.958565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1450/2606] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:11.184311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:11.184923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:11.191395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:11.191843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:11.192602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:11.193037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:11.249959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:17:11.250219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:17:11.318632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:11.326947 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:11.328443 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:11.329607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3df2529b-7e1e-4ce4-8e63-e500189bf143 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.149244 Jun 24 09:17:11.330195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1157/2607] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:11.974599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:11.975220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:11.981729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:11.982188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:11.982949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:11.983419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:12.044023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:12.052256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-46fe9fb5-0143-4c41-b8b0-806fffaec846 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081579 Jun 24 09:17:12.052816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1451/2608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:12.348107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:12.348671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:12.355225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:12.355703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:12.356471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:12.356910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:12.484464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:12.493436 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:12.494977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:12.496138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5753df45-285b-4969-a3c2-39a59556266c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152083 Jun 24 09:17:12.496703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1158/2609] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:13.068321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:13.068956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:13.075323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:13.081174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:13.082645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:13.083087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:13.142448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:13.150850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f6347bcd-b95c-4422-8128-8b738feff790 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086445 Jun 24 09:17:13.151416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1452/2610] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:13.515031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:13.515647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:13.522308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:13.522775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:13.523570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:13.524009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:13.649440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:13.657833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:13.659370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:13.660535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c46d6ac9-ee43-4f2a-8f58-115e2ebabb8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.149462 Jun 24 09:17:13.661098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1159/2611] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:14.167387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:14.168000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:14.174864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:14.175373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:14.176174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:14.176615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:14.239675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:14.247552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f92f7984-8012-45dc-b52a-77ba95b48e93 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084021 Jun 24 09:17:14.248106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1453/2612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:14.680288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:14.680902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:14.687777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:14.688397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:14.689153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:14.689693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:14.814559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:14.823027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:14.825261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:14.826779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b04fd13-e7d1-4099-a787-81a23eb07854 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150898 Jun 24 09:17:14.827385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1160/2613] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:15.264715 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:15.265320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:15.271757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:15.272201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:15.273477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:15.273929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:15.334743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:15.345399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9ab6b5e9-1894-40e5-8a3a-8802d026a5a5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084545 Jun 24 09:17:15.345989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1454/2614] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:15.847062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:15.847721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:15.854220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:15.854673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:15.855433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:15.855868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:15.984527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:15.993339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:15.994864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:15.996038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3453e70c-f873-406d-b6a5-1ba289f0fb83 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152879 Jun 24 09:17:15.996597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1161/2615] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:16.362240 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:16.362874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:16.372813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:16.373269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:16.374059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:16.374499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:16.434235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:16.442156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-90837d80-41e7-4256-864e-c4deafe2edc6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083741 Jun 24 09:17:16.442711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1455/2616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:17.014333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:17.015050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:17.021465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:17.021939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:17.022697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:17.023182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:17.147636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:17.155990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:17.157476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:17.158668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ccce867-c503-4ce7-960e-4b9fccbc2248 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.148223 Jun 24 09:17:17.159216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1162/2617] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:17.460622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:17.461229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:17.467651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:17.468095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:17.468840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:17.469269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:17.535612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:17.544214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-79965d14-eeb0-485a-a257-e240a606cda9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087954 Jun 24 09:17:17.544770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1456/2618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:17.998067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:17.998563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:18.004598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.005045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.005819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.006254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.029503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ef1ec7d1-b788-4f86-98c0-93d9c39da373 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/ips" status: 200 len: 151 microversion: 2.1 time: 0.135098 Jun 24 09:17:18.030121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1163/2619] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:17:17 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/ips => generated 151 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:17:18.178186 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:18.179655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:18.186431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.186900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.187788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.188225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.311601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:18.319835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:18.321317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:18.323115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b73e9561-c9cf-4822-8783-a4600330e1b8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.149186 Jun 24 09:17:18.323695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1457/2620] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:18.560929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:18.561576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:18.567600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.568050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.568812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:18.569244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:18.628620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:18.636460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c795dc7c-6f89-4778-b6a3-d4a6e52dac2c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079425 Jun 24 09:17:18.637022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1164/2621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:19.342120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:19.342717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:19.349215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:19.349682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:19.350466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:19.350917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:19.654598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:19.655314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:19.661469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:19.662233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:19.662994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:19.663420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:19.726613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:19.735109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:19.736694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:19.737884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4048b166-0ebe-43c8-a241-bd1437f4bb78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.399639 Jun 24 09:17:19.738431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1458/2622] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:19.742402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:19.750475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-634bdbdc-921a-402f-9e7c-015189e6eb05 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.099985 Jun 24 09:17:19.751027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1165/2623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:20.756369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:20.757478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:20.764051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:20.764502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:20.765257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:20.765712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:20.767932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:20.768610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:20.775078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:20.775526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:20.776282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:20.776719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:20.851512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:20.859328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f9d80031-93f7-4abb-ab81-11d6ab7278de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.095507 Jun 24 09:17:20.859887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1166/2624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:20.912833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:20.921561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:20.923071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:20.924212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a0469f4e-6380-4e6a-b63a-5fc89c684bd4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.171821 Jun 24 09:17:20.924757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1459/2625] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:21.877054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:21.877607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:21.884546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:21.884988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:21.885766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:21.886204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:21.942777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:21.943382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:21.946500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:21.950748 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:21.951190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:21.951940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:21.952391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:21.954361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-12233ec5-c796-46c3-9f4f-21f901565df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081302 Jun 24 09:17:21.954927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1167/2626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:22.075410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:22.083635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:22.085175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:22.086344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e62e3143-5835-429e-a79d-24728b54d91d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.147422 Jun 24 09:17:22.086893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1460/2627] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:17:22.971152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:22.971697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:22.978935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:22.979384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:22.980129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:22.980556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:23.040254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:23.048076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e01bf8a8-7522-4fc6-934c-d848b3bf60d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080853 Jun 24 09:17:23.048635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1168/2628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:23.104235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:23.104839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:23.111245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:23.111691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:23.112439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:23.112872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:23.239850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:23.248161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:23.249673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:23.250841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a7e9f9ae-353a-4cc9-834c-7410bccf874f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.150512 Jun 24 09:17:23.251400 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1461/2629] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:23.770602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:17:23.770831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:17:24.064017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:24.064634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:24.071093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:24.071544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:24.072302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:24.072744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:24.131967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:24.139980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10b95859-1f6a-401a-83e5-339aaf514c9d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079856 Jun 24 09:17:24.140545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1169/2630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:24.269397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:24.270037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:24.277035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:24.277482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:24.278278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:24.278713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:24.405190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:24.414309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:24.415791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:24.416927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a107456-e754-42a1-8e99-b2c74e47a753 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151381 Jun 24 09:17:24.417479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1462/2631] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:25.157417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:25.158084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:25.165009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:25.165456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:25.166247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:25.166687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:25.228334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:25.236117 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-31d2daa5-1b99-42eb-b5d3-a13f129a4106 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082596 Jun 24 09:17:25.236684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1170/2632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:25.435642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:25.436175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:25.442639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:25.443079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:25.443823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:25.444417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:25.571931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:25.580413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:25.581931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:25.583079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7e4259e7-f2a3-4680-a267-07c4c7cdf038 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151331 Jun 24 09:17:25.583637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1463/2633] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:26.253319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:26.253960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:26.260866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:26.261311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:26.262097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:26.262531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:26.322308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:26.330106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-52bd9c56-97cd-4b0c-91d2-f9bb79d0fa5d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080552 Jun 24 09:17:26.330671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1171/2634] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:26.601278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:26.601917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:26.608581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:26.609025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:26.609804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:26.610236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:26.625497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:26.738829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:26.747713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:26.749193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:26.750351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d04cf9f5-a365-4c08-9a5d-8589b971d8d8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152972 Jun 24 09:17:26.750903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1464/2635] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:27.347652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:27.348254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:27.355321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:27.355770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:27.356526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:27.356963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:27.371842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:27.418178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:27.425983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c2a78f55-97c7-40f2-925a-3b2665a2ca7c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082168 Jun 24 09:17:27.426544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1172/2636] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:27.768320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:27.768933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:27.776104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:27.776548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:27.777303 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:27.777765 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:27.906027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:27.914802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:27.916304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:27.917461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5fe10264-d276-4958-8b39-06c0b639b1d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.153066 Jun 24 09:17:27.918040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1465/2637] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:28.442630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:28.443276 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:28.446071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=54 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:28.451417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:28.451865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:28.452623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:28.453057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:28.512507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:28.520226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-120388c5-c93e-42c9-a7f9-c9daaaa7a20a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081405 Jun 24 09:17:28.520781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1173/2638] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:28.936301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:28.936900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:28.943369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:28.943813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:28.945178 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:28.945604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:29.069685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:29.078043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:29.079547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:29.080706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8d205fe-b42f-482e-9c38-ece3d8c76fc7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.148324 Jun 24 09:17:29.081298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1466/2639] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:29.538542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:29.539137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:29.545587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:29.546063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:29.546823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:29.547260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:29.606485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:29.614523 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8852b369-af73-4e3e-839c-e20c1c11b4bb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080714 Jun 24 09:17:29.615088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1174/2640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:30.098995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:30.099606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:30.106118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:30.106570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:30.107323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:30.107758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:30.234971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:30.244381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:30.245906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:30.247065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7edd5783-e514-4b25-8003-e64879a091a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151959 Jun 24 09:17:30.247625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1467/2641] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:30.631288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:30.631906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:30.638362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:30.638811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:30.639572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:30.640008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:30.699706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:30.707517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d18cc745-5327-49ef-a8ed-0996f39e0ae6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080161 Jun 24 09:17:30.708080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1175/2642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:31.265737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:31.266375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:31.273425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:31.273897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:31.274652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:31.275087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:31.402418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:31.410730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:31.412438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:31.413593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-424ada47-7b73-479a-9cf4-eb5f63d9c5c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.151729 Jun 24 09:17:31.414177 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1468/2643] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:31.724128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:31.724663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:31.731287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:31.731741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:31.732601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:31.733041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:31.792456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:31.800366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3716adf7-e185-4add-8a7e-ccccdf4ec70e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080189 Jun 24 09:17:31.800938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1176/2644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:32.431196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:32.431804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:32.438243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:32.438693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:32.439446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:32.439883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:32.566089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:32.574481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:32.575980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:32.577134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b271a061-01e3-47ac-945a-7d0e986ee86f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.149859 Jun 24 09:17:32.577711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1469/2645] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:32.817625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:32.818261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:32.824737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:32.825194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:32.825991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:32.826438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:32.887296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:32.895153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96e313f4-1a1c-4528-9463-49897cf083d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081330 Jun 24 09:17:32.895720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1177/2646] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:33.596170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:33.596780 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:33.603961 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:33.604484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:33.605235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:33.605688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:33.733422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:33.742467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:33.743968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:33.745120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-468049e4-569d-46b3-8836-b64b7b53ddc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.152903 Jun 24 09:17:33.745698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1470/2647] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:33.912287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:33.913412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:33.919916 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:33.920362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:33.921113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:33.921542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:33.980560 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:33.988599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8db699f0-b6f3-43eb-ae04-eb8b417d11b6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080461 Jun 24 09:17:33.989171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1178/2648] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:34.764054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:34.765146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:34.775319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:34.775766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:34.776821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:34.777256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:34.924930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:34.934199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:34.935692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:34.936842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-67abe72a-624b-4266-b03f-b18a8c07f84a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.176969 Jun 24 09:17:34.937486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1471/2649] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:35.006025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:35.007217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:35.013755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:35.014207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:35.014975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:35.015408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:35.077602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:35.085492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f10cb8d4-d8a1-4314-9f30-c2f07b1e555a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083463 Jun 24 09:17:35.086076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1179/2650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:35.956359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:35.956906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:35.963986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:35.964434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:35.965189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:35.965620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:36.096858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:36.102229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:36.102836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:36.105245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:36.106779 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:36.107939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ccb05763-bbe3-413f-aeae-fd2cfcb40c7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.155618 Jun 24 09:17:36.108486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1472/2651] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:36.109294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:36.109787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:36.110562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:36.111030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:36.170392 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:36.178096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-358733ea-5dbd-4ffb-b24c-2d7c5d223d81 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079687 Jun 24 09:17:36.179300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1180/2652] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:37.126564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:37.127193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:37.133595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:37.134072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:37.134821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:37.135251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:37.195413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:37.196195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:37.202899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:37.203350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:37.204114 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:37.204550 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:37.271064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:37.279533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-87fe87ba-d0a3-4bd3-8b9d-c4ebbe6bfde3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087994 Jun 24 09:17:37.280112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1181/2653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:37.292884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:37.301168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:37.302706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:37.303925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f7e933f0-9d1f-4948-8aa4-2a94a1ef7e54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.181547 Jun 24 09:17:37.304464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1473/2654] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:38.296433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:38.299177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:38.306499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:38.306980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:38.307752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:38.308188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:38.325068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:38.326905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:38.329694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=54 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:38.336769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:38.337288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:38.338155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:38.338653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:38.395055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:38.406006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-187ad9c8-2ccd-427c-80bf-03f90b9d73f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.113299 Jun 24 09:17:38.406775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1182/2655] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:38.497266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:38.505767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:38.507328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:38.508487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ee2b4fb8-582b-43e9-8eee-ebad4857f561 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.190092 Jun 24 09:17:38.509039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1474/2656] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:39.424307 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:39.424958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:39.433397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:39.433897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:39.434809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:39.435256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:39.497897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:39.507710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-21c669bd-5946-4e52-9ae7-ab51095a4569 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087291 Jun 24 09:17:39.508287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1183/2657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:39.527082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:39.527542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:39.534409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:39.534861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:39.535632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:39.536071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:39.679349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:39.687910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:39.689415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:39.690631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0bb840a9-93ce-44a4-8ca3-962478279500 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1801 microversion: 2.20 time: 0.167723 Jun 24 09:17:39.691190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1475/2658] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:40.398514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-106e4641-7289-4b02-96de-b49a6a4aca91 req-390601ab-c3eb-4fe2-ac7f-8b010747fe83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cb66bde-d133-41de-b6dd-295b0676be9e", "name": "network-vif-deleted", "tag": "71f49d9c-e32c-47fe-8849-340e5307d318"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:17:40.407958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-106e4641-7289-4b02-96de-b49a6a4aca91 req-390601ab-c3eb-4fe2-ac7f-8b010747fe83 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:40.408552 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-106e4641-7289-4b02-96de-b49a6a4aca91 req-390601ab-c3eb-4fe2-ac7f-8b010747fe83 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:40.422648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-106e4641-7289-4b02-96de-b49a6a4aca91 req-390601ab-c3eb-4fe2-ac7f-8b010747fe83 service nova] Creating event network-vif-deleted:71f49d9c-e32c-47fe-8849-340e5307d318 for instance 6cb66bde-d133-41de-b6dd-295b0676be9e on hv-cinder-78729 Jun 24 09:17:40.440196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-106e4641-7289-4b02-96de-b49a6a4aca91 req-390601ab-c3eb-4fe2-ac7f-8b010747fe83 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045983 Jun 24 09:17:40.440958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1184/2659] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:17:40.525425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:40.526511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:40.534263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:40.534963 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:40.535530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:40.535970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:40.604822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:40.613706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f081ce47-af3c-430b-88a6-c254c542f5c4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.093035 Jun 24 09:17:40.614674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1476/2660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:40.710287 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:40.710930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:40.717215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:40.717723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:40.718544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:40.718989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:40.780948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:40.789966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:40.791469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:40.792631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-868e33e5-54c7-474e-9f0c-b07ac4e68359 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086866 Jun 24 09:17:40.793193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1185/2661] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:41.630474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:41.631090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:41.637559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:41.638040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:41.638796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:41.639233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:41.698458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:41.706251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7a3203f7-21e6-428b-93cf-ff4d71c337d3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079652 Jun 24 09:17:41.706809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1477/2662] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:41.813974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:41.814592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:41.821506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:41.821997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:41.822766 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:41.823206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:41.884234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:41.892609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:41.894151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:41.895295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-39fe97bd-a67e-4b0c-8fd6-fd7a0fd27efd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085316 Jun 24 09:17:41.895852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1186/2663] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:42.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:42.723585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:42.730489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:42.730929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:42.731673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:42.732098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:42.793924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:42.801986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b5aee47e-f1f9-4b11-8c99-30a562fad109 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082828 Jun 24 09:17:42.802544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1478/2664] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:42.914587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:42.915138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:42.921575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:42.922058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:42.922819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:42.923258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:42.983181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:42.991393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:42.992900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:42.994075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6b87122e-df52-4f27-b99d-91719d26e2b9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084252 Jun 24 09:17:42.994642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1187/2665] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:43.820351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:43.820957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:43.827067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:43.827515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:43.828270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:43.828703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:43.887194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:43.895028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4ab967ec-9e90-4151-9f20-73083ea1d1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079332 Jun 24 09:17:43.895582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1479/2666] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:44.012578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:44.013185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:44.019750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:44.020193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:44.020944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:44.021374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:44.081435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:44.089791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:44.091291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:44.092432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-82ad713a-008e-4486-b37c-7d27b9152487 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083755 Jun 24 09:17:44.092992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1188/2667] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:44.911319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:44.911863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:44.918719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:44.919169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:44.919928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:44.920363 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:44.982802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:44.990648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-58ad29dd-ee88-40f7-be4f-8f6a97b40d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083421 Jun 24 09:17:44.991236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1480/2668] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:45.110371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:45.110983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:45.117438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:45.117917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:45.118705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:45.119139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:45.179952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:45.182248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:45.189633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:45.191157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:45.192292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98e3bb46-6fca-4718-b7fc-9184345f8bb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085779 Jun 24 09:17:45.192849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1189/2669] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:46.007504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:46.008055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:46.014486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:46.014931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:46.015711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:46.016140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:46.019951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:46.076644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:46.084993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9521ea7-c219-4a91-be09-93db907df5ea tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080927 Jun 24 09:17:46.085552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1481/2670] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:46.214344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:46.214978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:46.221694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:46.222470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:46.223244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:46.223933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:46.285558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:46.294525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:46.296007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:46.297136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee8e61cb-926d-42e8-a771-e1fc17c784df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086657 Jun 24 09:17:46.297706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1190/2671] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:47.102196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:47.103081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:47.109562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:47.110048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:47.110811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:47.111258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:47.173244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:47.181838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-196d590b-8d8b-4c7f-9964-acdd187ccecd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084049 Jun 24 09:17:47.182407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1482/2672] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:47.314136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:47.314748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:47.321207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:47.321721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:47.322482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:47.322911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:47.382355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:47.390664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:47.392160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:47.393297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-648039cd-ce9f-4dda-bc41-71a7240b44d1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083074 Jun 24 09:17:47.393973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1191/2673] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:48.198690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:48.199297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:48.205728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:48.206175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:48.206921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:48.207351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:48.266876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:48.274639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f9142b01-8d83-4dfa-a38a-99ecb11bfad1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079819 Jun 24 09:17:48.275190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1483/2674] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:48.411670 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:48.412582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:48.419040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:48.419492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:48.420251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:48.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:48.482911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:48.491771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:48.493265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:48.494429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3d1af2d9-5748-4dae-942e-ca0aed156a1c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086624 Jun 24 09:17:48.494991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1192/2675] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:49.292704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:49.293305 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:49.299969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:49.300424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:49.301198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:49.301641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:49.363807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:49.372289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-82dd3a27-cb52-47b4-b829-f413985d89b3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083400 Jun 24 09:17:49.372847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1484/2676] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:49.514634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:49.515460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:49.522046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:49.522517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:49.523322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:49.523759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:49.583981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:49.592337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:49.593865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:49.594999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8f0b5cc4-9eda-4ca7-a39d-0c058d02a880 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085962 Jun 24 09:17:49.595556 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1193/2677] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:50.389029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:50.389684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:50.396161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:50.396609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:50.398062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:50.398500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:50.459773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:50.467640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e784d7a4-f579-4ea8-a4ec-a490ec230edd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082502 Jun 24 09:17:50.468211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1485/2678] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:50.613482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:50.614122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:50.621116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:50.621568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:50.622365 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:50.622801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:50.682614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:50.690826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:50.692325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:50.693456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9d6514ee-2678-4357-91d9-dedad13842ef tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084018 Jun 24 09:17:50.694621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1194/2679] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:51.484634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:51.485184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:51.491682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:51.492130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:51.492890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:51.493321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:51.555115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:51.562982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-43f23bcd-9d8e-4b45-9296-954a019a6913 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082303 Jun 24 09:17:51.563542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1486/2680] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:51.712783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:51.713402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:51.719968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:51.720425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:51.721200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:51.721642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:51.781946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:51.790580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:51.792095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:51.793259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-adf6ab45-6137-46f1-a001-204a2832a514 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085156 Jun 24 09:17:51.793888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1195/2681] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:52.580833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:52.581422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:52.588554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:52.589002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:52.589811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:52.590246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:52.650057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:52.657931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3deae13e-7945-4f1a-9941-d492cf16f3a6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080946 Jun 24 09:17:52.658488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1487/2682] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:52.811419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:52.812033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:52.818568 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:52.819598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:52.820364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:52.820801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:52.879961 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:52.888806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:52.890318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:52.891437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9bf047af-c5e5-4ee2-90a0-9c9ad48c167a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083937 Jun 24 09:17:52.892027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1196/2683] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:53.675509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:53.676123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:53.682583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:53.683031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:53.683785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:53.684222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:53.746373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:53.754168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b08ab57c-03f7-45a4-a9fc-c60c46f02627 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082546 Jun 24 09:17:53.754724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1488/2684] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:17:53.909176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:53.909745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:53.916354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:53.916797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:53.917547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:53.917999 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:53.977338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:53.985448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:53.986949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:53.988078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-010cfc7c-0636-47ae-9da5-a3229ee64232 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.082857 Jun 24 09:17:53.988637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1197/2685] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:54.771340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:54.771998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:54.778581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:54.779129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:54.779879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:54.780307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:54.839370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:54.847407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-51016a90-d078-4d8c-8cf3-e83c99b63d22 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079936 Jun 24 09:17:54.847976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1489/2686] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:55.005894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:55.006459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:55.012946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:55.013390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:55.014177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:55.014609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:55.074167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:55.082336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:55.083819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:55.085468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f45ad51c-1381-432e-94d9-a585cbd48c68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083477 Jun 24 09:17:55.086044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1198/2687] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:55.864438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:55.864971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:55.872036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:55.872489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:55.873242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:55.873690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:55.935089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:55.942925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-28ede75d-7b21-4319-8fdc-5eb1f417f888 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082460 Jun 24 09:17:55.943482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1490/2688] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:56.103432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:56.104036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:56.110905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:56.111349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:56.112106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:56.112540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:56.179820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:56.188055 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:56.189527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:56.190702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-19c09cb0-f466-4468-ba0c-c6340faed1eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.091670 Jun 24 09:17:56.191259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1199/2689] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:17:56.960999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:56.961534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:56.967933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:56.968375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:56.969117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:56.969545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:57.028483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:57.036206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ad24b01b-7fbc-4eb8-9432-a8651c171d5c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079663 Jun 24 09:17:57.036758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1491/2690] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:57.208653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:57.209266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:57.215775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:57.216198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:57.216960 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:57.217397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:57.276952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:57.285218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:57.286749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:57.288722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-68bf9035-7f56-415c-8579-f426982331fa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083665 Jun 24 09:17:57.289740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1200/2691] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:58.053331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:58.054023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:58.060453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:58.060904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:58.061655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:58.062109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:58.124252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:58.132332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a3febd20-6013-4d74-8a75-e86d48059f41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082969 Jun 24 09:17:58.132897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1492/2692] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:58.310183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:58.310716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:58.317152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:58.317599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:58.318381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:58.318812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:58.378220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:58.386383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:58.387864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:58.389027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3debc435-6e43-4244-aae2-c5b851e7e970 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.082752 Jun 24 09:17:58.389581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1201/2693] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:17:59.149782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:59.150387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:59.156965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:59.157420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:59.158218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:59.158659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:59.219523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:59.227611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b21cc50f-1e17-42d5-bc88-4e07fd277837 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082508 Jun 24 09:17:59.228171 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1493/2694] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:17:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:17:59.407419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:17:59.407968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:17:59.410294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=58 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:59.416153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:59.416611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:59.417380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:17:59.417861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:17:59.477836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:59.486127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:59.487626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:17:59.488767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-45053656-ffac-4076-b08d-71c365c99a08 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085320 Jun 24 09:17:59.489340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1202/2695] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:17:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:00.244775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:00.245358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:00.251727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:00.252176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:00.252932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:00.253370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:00.315871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:00.323855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fcdde489-0837-41e4-bcb2-750afa586318 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083074 Jun 24 09:18:00.324414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1494/2696] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:00.507721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:00.508241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:00.514714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:00.515162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:00.515915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:00.516348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:00.576339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:00.584571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:00.586078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:00.587204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-358d74fd-840e-49c8-9a42-844cb133b9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084037 Jun 24 09:18:00.587757 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1203/2697] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:01.340917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:01.341527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:01.348048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:01.348497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:01.349287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:01.349754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:01.410218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:01.418263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3158bfe-a5fb-4838-a75f-b8b5c82af583 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081219 Jun 24 09:18:01.418815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1495/2698] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:01.604923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:01.605564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:01.612255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:01.612707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:01.613475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:01.613945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:01.674312 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:01.683136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:01.684639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:01.685879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-89df5b31-18f3-4ada-b3c0-bf58fc8a7ee0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084753 Jun 24 09:18:01.686453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1204/2699] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:02.435212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:02.435814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:02.442182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:02.442628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:02.443372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:02.444543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:02.505565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:02.514060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-77df7bb7-efbd-49c1-a176-a08ffd53605e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082721 Jun 24 09:18:02.514612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1496/2700] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:02.705021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:02.705566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:02.712119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:02.712563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:02.713324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:02.713817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:02.776480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:02.784610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:02.786118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:02.787244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-60b71354-a6fd-4b31-a9f9-48b5aef89c78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086310 Jun 24 09:18:02.788554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1205/2701] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:03.530705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:03.531311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:03.538041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:03.538486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:03.539232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:03.539662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:03.598525 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:03.600654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:03.607840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-623bad76-6bbd-4e9d-84c5-fda01ff8c3f2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080876 Jun 24 09:18:03.608412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1497/2702] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:03.807154 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:03.807748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:03.814240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:03.814687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:03.815437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:03.815866 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:03.830868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:03.876709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:03.885555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:03.887056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:03.888178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0d574e06-1e24-457b-ae55-ed244b571de7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085059 Jun 24 09:18:03.888726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1206/2703] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:04.624331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:04.624941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:04.631409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:04.631854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:04.632603 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:04.633034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:04.695980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:04.703938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ea56ebe-adfc-4b03-b1c8-43f811682704 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083484 Jun 24 09:18:04.704514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1498/2704] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:04.906395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:04.906972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:04.914203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:04.914652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:04.915411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:04.915851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:04.976931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:04.985236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:04.986762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:04.987895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0c9eebd9-12c5-460f-a1b4-022353998f77 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085561 Jun 24 09:18:04.988447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1207/2705] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:05.721537 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:05.722102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:05.728587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:05.729033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:05.729815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:05.730244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:05.791619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:05.799504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a8db1076-6fa6-4626-acd2-92e0e3a1d4a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081888 Jun 24 09:18:05.800100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1499/2706] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:06.005737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:06.006268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:06.012808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:06.013259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:06.014097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:06.014539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:06.075008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:06.083296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:06.084823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:06.085983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e4bb18e-7a77-4f29-b1e1-d1becf246b21 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084165 Jun 24 09:18:06.086535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1208/2707] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:06.816864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:06.817471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:06.824529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:06.824978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:06.825752 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:06.826187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:06.887879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:06.895602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2539656f-f545-489f-8e24-deb39ffae371 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082620 Jun 24 09:18:06.896158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1500/2708] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:07.104201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:07.104774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:07.111346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:07.111799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:07.112557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:07.112995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:07.172662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:07.181596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:07.183124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:07.184254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0c096530-b301-45a3-90f6-44f1a7ac1ce1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084276 Jun 24 09:18:07.185044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1209/2709] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:07.912281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:07.913762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:07.920184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:07.920632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:07.921388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:07.921857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:07.980673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:07.988809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7129c50c-07a3-4651-aa8f-490517d54ac2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080430 Jun 24 09:18:07.989370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1501/2710] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:08.203203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:08.203763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:08.210564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:08.211020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:08.212044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:08.212492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:08.272211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:08.280574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:08.282098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:08.283240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ed381103-f242-4403-86ff-e9c896f6b7bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084126 Jun 24 09:18:08.283802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1210/2711] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:09.006204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:09.006762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:09.009046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:09.014324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:09.014775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:09.015533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:09.015970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:09.078069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:09.085921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1d989a44-f51c-449b-8570-05a9d9bd2af9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083682 Jun 24 09:18:09.086478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1502/2712] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:09.302083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:09.302698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:09.309178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:09.309644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:09.310437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:09.310872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:09.373806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:09.382225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:09.383724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:09.384865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f3ca6d7d-0701-4fd5-b0e6-b16b043421ff tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086818 Jun 24 09:18:09.385429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1211/2713] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:10.101879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:10.102493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:10.109054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:10.109502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:10.110311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:10.110751 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:10.171895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:10.180510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1da0a1bb-24d6-421d-bab3-dce1f6151b27 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082510 Jun 24 09:18:10.181081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1503/2714] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:10.402687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:10.403404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:10.409872 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:10.410313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:10.411061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:10.411490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:10.473158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:10.482048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:10.483534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:10.484671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e62ad5ef-e7b5-4063-b0e1-3e8365bae65a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085836 Jun 24 09:18:10.485240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1212/2715] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:11.198309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:11.198921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:11.205466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:11.205943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:11.206699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:11.207128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:11.269949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:11.278569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6403e69c-5354-4bea-ac57-05baf4be2c45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084619 Jun 24 09:18:11.279124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1504/2716] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:11.503301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:11.503951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:11.511106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:11.511561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:11.512563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:11.513361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:11.576478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:11.584929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:11.586470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:11.587609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ecbfff9-fdcb-4525-b64f-530267a1d8b3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088280 Jun 24 09:18:11.588177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1213/2717] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:12.295797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:12.296436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:12.303026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:12.303478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:12.304238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:12.304677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:12.365006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:12.372886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3cfce630-a4af-469a-9b44-1cf7645ab715 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080965 Jun 24 09:18:12.373457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1505/2718] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:12.605063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:12.605612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:12.612120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:12.612564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:12.613322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:12.613780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:12.673499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:12.681770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:12.683284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:12.684403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dab7ac3d-7ff4-48a7-94cc-ba21e25ec04d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083375 Jun 24 09:18:12.684954 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1214/2719] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:13.389983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:13.390594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:13.396589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:13.397039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:13.397820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:13.398254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:13.459799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:13.467902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-935f950a-e297-4969-aadf-e1cfc8c5365d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082005 Jun 24 09:18:13.468461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1506/2720] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:13.702683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:13.703285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:13.709864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:13.710278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:13.711025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:13.711452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:13.775457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:13.783683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:13.785186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:13.786349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0edc8f5a-525c-4b8c-b915-9be73006ef61 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087573 Jun 24 09:18:13.786906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1215/2721] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:14.485157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:14.485771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:14.492280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:14.492725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:14.493473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:14.493936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:14.552674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:14.560601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8480b7d5-a963-4c23-a529-a6430b6cc60b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079331 Jun 24 09:18:14.561160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1507/2722] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:14.804435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:14.805042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:14.811510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:14.811983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:14.812743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:14.813174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:14.872269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:14.880538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:14.882107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:14.883221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8334d4db-744b-4fb4-a9c0-eb4644a39fd5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083279 Jun 24 09:18:14.883779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1216/2723] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:15.577273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:15.577914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:15.584642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:15.585340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:15.586115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:15.586546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:15.648144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:15.655955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-347b31f7-8360-4c4a-9c42-38658d9b315c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082572 Jun 24 09:18:15.656507 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1508/2724] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:15.901543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:15.902189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:15.908665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:15.909122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:15.909939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:15.910377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:15.969993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:15.978981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:15.980483 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:15.981621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4247bf71-ee51-482e-b2b6-852c8a3126f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084008 Jun 24 09:18:15.982209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1217/2725] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:16.673361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:16.673991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:16.680941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:16.681387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:16.682170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:16.682597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:16.742166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:16.750019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-77695d89-55d9-440c-a295-7c1abbdb7dd8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080484 Jun 24 09:18:16.750584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1509/2726] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:16.999618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:17.000155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:17.007213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:17.007662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:17.008420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:17.008855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:17.070574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:17.078895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:17.080395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:17.081531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b7774ba7-8550-4f95-9bf9-6b5218e0412f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085895 Jun 24 09:18:17.082109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1218/2727] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:17.767358 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:17.767964 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:17.774454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:17.774895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:17.775642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:17.776068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:17.843707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:17.852079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-39d0bc41-3eaf-4cc6-b6d4-e9e5eeb72274 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088655 Jun 24 09:18:17.852662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1510/2728] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:18.102022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:18.102667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:18.109006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:18.109451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:18.110246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:18.110678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:18.171008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:18.179240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:18.180734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:18.181901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-de3bd221-6ec9-4680-aa72-102bc4de9bc6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084788 Jun 24 09:18:18.182486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1219/2729] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:18.869456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:18.870059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:18.876510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:18.876956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:18.877735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:18.878170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:18.937293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:18.945770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-92ea08ac-c12f-469b-8164-406fb64f1429 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080793 Jun 24 09:18:18.946328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1511/2730] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:19.199413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:19.200054 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:19.206518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:19.206969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:19.207728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:19.208168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:19.268576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:19.277823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:19.279323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:19.280455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-85656a12-abb4-471c-89aa-2e85c563c5f7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085276 Jun 24 09:18:19.281014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1220/2731] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:19.961770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:19.962321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:19.969033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:19.969482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:19.970268 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:19.970706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:20.033848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:20.042336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f2e77c8-41f0-4a08-a455-e51dd2484eb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084510 Jun 24 09:18:20.042903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1512/2732] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:20.297566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:20.298214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:20.305027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:20.305477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:20.306357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:20.306780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:20.370662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:20.379014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:20.380505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:20.381638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b815d19b-8433-4cd7-9ecd-8f1fd510189b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087979 Jun 24 09:18:20.382214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1221/2733] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:21.059188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:21.059793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:21.066292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:21.066736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:21.067482 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:21.067911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:21.126585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:21.134483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4025c9cc-294d-4b93-b959-987ffd8fbcc8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079162 Jun 24 09:18:21.135043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1513/2734] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:21.400321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:21.401288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:21.409185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:21.409631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:21.410434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:21.410870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:21.471838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:21.480672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:21.482200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:21.483344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a259807d-c1a9-41ce-8272-1f5e03a9d6d9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087905 Jun 24 09:18:21.483902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1222/2735] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:22.151361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:22.151962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:22.158446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:22.158891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:22.159642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:22.160075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:22.174899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:22.222749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:22.230572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a2cea27-226d-46d8-91eb-2c2c640e3da4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083204 Jun 24 09:18:22.231130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1514/2736] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:22.500424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:22.501026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:22.507513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:22.507959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:22.508714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:22.509144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:22.512980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:22.568437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:22.576712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:22.578216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:22.579343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78e571b3-fc41-4dcd-bdd4-2cddec05d0a3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.082830 Jun 24 09:18:22.579914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1223/2737] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:23.247351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:23.247960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:23.254502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:23.254951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:23.255705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:23.256141 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:23.323937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:23.331830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-243235cf-5d07-419e-97a3-f931c6cf51de tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088437 Jun 24 09:18:23.332398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1515/2738] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:23.597538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:23.598174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:23.604698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:23.605153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:23.605948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:23.606387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:23.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:23.674800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:23.676288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:23.677423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a4e4d58a-4725-45c7-ae7b-3a957384ea02 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083802 Jun 24 09:18:23.678019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1224/2739] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:24.349138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:24.349755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:24.356804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:24.357246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:24.358015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:24.358442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:24.419197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:24.426957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-05dfccb3-c468-4a27-9cfe-ce217194a1be tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081692 Jun 24 09:18:24.427509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1516/2740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:24.697748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:24.698360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:24.704756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:24.705201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:24.706014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:24.706448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:24.768580 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:24.781682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:24.783175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:24.784320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e9a263f8-162f-4ed8-9cfc-449100ad6307 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.091740 Jun 24 09:18:24.784883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1225/2741] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:25.443810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:25.444416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:25.450911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:25.451360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:25.452115 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:25.452549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:25.511161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:25.518967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-17ff6733-b67a-4046-9549-3d7f2b270889 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079095 Jun 24 09:18:25.519534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1517/2742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:25.802545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:25.803174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:25.809636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:25.810119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:25.810875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:25.811310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:25.874979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:25.883256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:25.884744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:25.885920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-91bf03b6-fbd0-4991-8e81-d4afcbd48648 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087233 Jun 24 09:18:25.886485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1226/2743] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:26.535693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:26.536300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:26.543762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:26.544206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:26.544947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:26.545375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:26.610579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:26.618617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e0488160-92cd-4778-a505-66d85febc105 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086799 Jun 24 09:18:26.619189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1518/2744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:26.904196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:26.904802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:26.911343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:26.911790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:26.912543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:26.913404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:26.973585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:26.982619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:26.984545 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:26.985689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cc243a3f-56af-4fa7-8d8a-fd6e0a31e4ae tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085358 Jun 24 09:18:26.986508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1227/2745] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:27.635212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:27.635834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:27.642421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:27.642873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:27.643628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:27.644062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:27.702668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:27.710421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0c2a457e-a804-4348-a49d-2bebcff405ec tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079133 Jun 24 09:18:27.710985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1519/2746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:28.004245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:28.004798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:28.011504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:28.011959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:28.012717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:28.013155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:28.072398 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:28.080602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:28.082129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:28.083266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-91af9e4a-61ab-4419-9736-5eedf368cd1b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083039 Jun 24 09:18:28.083824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1228/2747] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:28.727322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:28.727939 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:28.734485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:28.734932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:28.735688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:28.736123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:28.797593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:28.805957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-390c2f18-5976-4db4-a0f5-eed9a4271da1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082504 Jun 24 09:18:28.806522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1520/2748] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:29.102144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:29.102755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:29.109345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:29.109826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:29.110619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:29.111052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:29.170933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:29.179785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:29.181290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:29.182450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4338c3d8-301f-4e37-9582-957e856ecc95 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084795 Jun 24 09:18:29.183004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1229/2749] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:29.823892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:29.824523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:29.830996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:29.831449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:29.832203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:29.832636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:29.891549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:29.899885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c92e2202-09b0-4fe6-b06e-ca47b4eddca5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079921 Jun 24 09:18:29.900442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1521/2750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:30.201011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:30.201551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:30.203887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=56 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:30.209410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:30.209884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:30.210644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:30.211075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:30.271460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:30.279699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:30.281173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:30.282346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fe826f43-173e-4562-9de4-273ac12972d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085307 Jun 24 09:18:30.282909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1230/2751] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:30.916977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:30.917497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:30.923935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:30.924379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:30.925127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:30.925556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:30.986771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:30.994581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b479d94f-cf18-4519-a9f4-c04ee2b1c185 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082140 Jun 24 09:18:30.995138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1522/2752] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:31.300216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:31.300834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:31.307317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:31.307774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:31.308531 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:31.308967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:31.367996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:31.376246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:31.377761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:31.378895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aca2ee9c-0b0c-4728-92e6-e7925d359941 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.082550 Jun 24 09:18:31.379454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1231/2753] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:32.010688 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:32.011254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:32.017742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:32.018148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:32.018907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:32.019339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:32.078211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:32.086066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-42ceccf6-8c24-4934-bbd8-666901755aa3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079340 Jun 24 09:18:32.086636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1523/2754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:32.397958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:32.398555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:32.405000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:32.405448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:32.406240 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:32.406677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:32.469354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:32.478355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:32.479851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:32.480990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-06ca65b2-4ff6-454d-a247-c3ca7a39c87c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087460 Jun 24 09:18:32.481543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1232/2755] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:33.102760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:33.103362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:33.109822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:33.110269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:33.111012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:33.111442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:33.172778 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:33.181122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2d179fd-2f24-48ba-b966-e4aacde27152 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082246 Jun 24 09:18:33.181689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1524/2756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:33.499109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:33.499673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:33.506174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:33.506626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:33.507390 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:33.507822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:33.567697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:33.575970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:33.577454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:33.578610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-147c2fcb-538a-40a7-9df7-902b82393c42 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083484 Jun 24 09:18:33.579165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1233/2757] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:34.197896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:34.198487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:34.204821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:34.205264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:34.206038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:34.206468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:34.267058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:34.275386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4e33c8a7-a97d-413c-8fa8-902040a5d985 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081433 Jun 24 09:18:34.275936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1525/2758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:34.595838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:34.596469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:34.602922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:34.603372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:34.604128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:34.604564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:34.664503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:34.672832 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:34.674374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:34.675509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fb7cdaaa-cc13-4492-ae99-b4b681df805c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083657 Jun 24 09:18:34.676089 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1234/2759] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:35.293032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:35.293698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:35.300199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:35.300655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:35.301428 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:35.301897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:35.371351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:35.379395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-09ce68ca-bfa0-42e5-9abd-6790adcf5934 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090450 Jun 24 09:18:35.379966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1526/2760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:35.693508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:35.694133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:35.701090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:35.701542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:35.702344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:35.702786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:35.764850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:35.775124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:35.776625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:35.777799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e973ee86-b44a-4bb8-bd82-cf4125d5d575 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088195 Jun 24 09:18:35.778361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1235/2761] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:36.395912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:36.396557 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:36.403014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:36.403464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:36.404218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:36.404656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:36.464299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:36.472134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f3ba6c7-00b9-484f-bae4-883d2a9be12d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080088 Jun 24 09:18:36.472705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1527/2762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:36.796709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:36.797329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:36.804420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:36.804870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:36.805629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:36.806091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:36.866190 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:36.874598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:36.876073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:36.877195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6f61874e-e998-4864-b7e5-b83295d133d4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084484 Jun 24 09:18:36.877798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1236/2763] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:37.681670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:37.682297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:37.688203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:37.688652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:37.689404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:37.689866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:37.751456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:37.759965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9b524bb-5135-41d4-9304-cc5296972d6e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.274436 Jun 24 09:18:37.760534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1528/2764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:38.017136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:38.017776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:38.023694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:38.024147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:38.025172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:38.025621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:38.325349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:38.333750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:38.335230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:38.336361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7158b93e-99e4-410f-a3b6-6d8d0f504f0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.445222 Jun 24 09:18:38.336912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1237/2765] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:38.776889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:38.777492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:38.784109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:38.784558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:38.785318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:38.785776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:38.845161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:38.853533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1970ece1-b12a-4aed-9c04-16bce787b6f9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080568 Jun 24 09:18:38.854436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1529/2766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:39.354212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:39.354792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:39.361185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:39.361628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:39.362407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:39.362837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:39.426506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:39.437753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:39.439267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:39.440424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-889c08b8-fdd0-4b85-9ffb-21f631d7143e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090094 Jun 24 09:18:39.440993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1238/2767] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:39.871095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:39.871638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:39.873950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:39.879225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:39.879675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:39.880432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:39.880870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:39.940148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:39.948063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4573e933-5378-426e-9481-a8c29b064da3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080957 Jun 24 09:18:39.948624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1530/2768] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:40.458922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:40.459599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:40.466627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:40.467071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:40.467817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:40.468247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:40.529336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:40.531520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:40.539245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:40.540725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:40.541881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a8fcaa14-75b2-4c91-bc91-febd7983cd9d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086841 Jun 24 09:18:40.542428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1239/2769] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:40.964987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:40.965601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:40.972181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:40.972632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:40.973990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:40.974436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:40.977466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:41.034214 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:41.042840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-43b51a29-dbbe-4cd0-9861-ab3106b85bde tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081785 Jun 24 09:18:41.043409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1531/2770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:41.559203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:41.559809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:41.566328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:41.566779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:41.567540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:41.567975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:41.627748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:41.636184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:41.637729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:41.638869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6a0ff26b-28ae-4fb5-b450-091727ddfeb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083582 Jun 24 09:18:41.639426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1240/2771] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:42.059678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:42.060256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:42.066705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:42.067151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:42.067894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:42.068322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:42.127735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:42.136182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-54b6aec3-de59-423f-907b-6da2b5e8ebb0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080589 Jun 24 09:18:42.136742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1532/2772] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:42.660227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:42.660837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:42.668025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:42.668465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:42.669214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:42.669641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:42.731718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:42.740142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:42.742370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:42.743499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5f8e452-2227-4c8c-8bc2-eca0e6ffdc36 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089120 Jun 24 09:18:42.744045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1241/2773] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:43.153496 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:43.154185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:43.160158 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:43.160608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:43.161361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:43.161851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:43.220641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:43.229010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-dac2bc22-c21e-4667-8c67-ee58031780f0 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079591 Jun 24 09:18:43.229578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1533/2774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:43.762167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:43.762775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:43.769450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:43.769926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:43.770680 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:43.771112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:43.831427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:43.839988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:43.841469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:43.842628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7d01337f-5e36-40b8-aaa2-ed5ee65d4dfc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084316 Jun 24 09:18:43.843173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1242/2775] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:44.246067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:44.246690 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:44.253256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:44.253742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:44.254504 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:44.254945 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:44.314101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:44.321974 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-37cdbbeb-d459-49f1-989a-fb637719611d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080334 Jun 24 09:18:44.322538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1534/2776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:44.859879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:44.860536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:44.867358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:44.867803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:44.868562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:44.869319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:44.932506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:44.941107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:44.942617 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:44.943767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ec57d689-5e76-4249-8d3b-fbca2f4a8864 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087790 Jun 24 09:18:44.944315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1243/2777] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:45.338687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:45.339317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:45.345817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:45.346275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:45.347032 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:45.347473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:45.406623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:45.414710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-45d24845-9536-4637-a2b0-b02bd7490005 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079893 Jun 24 09:18:45.415270 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1535/2778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:18:45.962488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:45.963014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:45.969765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:45.970210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:45.970962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:45.971389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:46.031309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:46.039894 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:46.041373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:46.042525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b56b8bf2-7bd0-4496-8e4d-1e2900a21be7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084105 Jun 24 09:18:46.043073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1244/2779] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:46.432309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:46.432922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:46.439485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:46.439940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:46.440699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:46.441137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:46.501710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:46.509768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-abd6b6b3-2b25-4cca-924a-06d0e28e4828 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081889 Jun 24 09:18:46.510335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1536/2780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:47.060338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:47.060943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:47.067468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:47.067909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:47.068664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:47.069088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:47.132132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:47.140825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:47.142335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:47.143461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-be631a97-056f-4144-a881-692864524810 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087085 Jun 24 09:18:47.144010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1245/2781] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:47.526853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:47.527493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:47.533966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:47.534413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:47.535160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:47.535591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:47.596318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:47.604129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c7e9cebe-826b-4a52-9741-4cf103a7429a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081300 Jun 24 09:18:47.604687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1537/2782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:48.161787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:48.162405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:48.170007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:48.170463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:48.171239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:48.171678 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:48.231521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:48.239904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:48.241401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:48.242567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c49017ba-b994-4559-bf27-b33d55a4fa9e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084750 Jun 24 09:18:48.243136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1246/2783] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:48.621269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:48.621907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:48.628335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:48.628776 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:48.629528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:48.629980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:48.689145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:48.697582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e05e0494-1e84-4868-a06e-ee0d8dfcb0f4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080242 Jun 24 09:18:48.698194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1538/2784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:49.260600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:49.261216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:49.267831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:49.268281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:49.269041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:49.269478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:49.332690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:49.341057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:49.342579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:49.343714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d2758ff2-651f-4f8a-94dd-f3dfb8ccf929 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087120 Jun 24 09:18:49.344278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1247/2785] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:49.715084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:49.715742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:49.722491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:49.722943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:49.723713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:49.724150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:49.783559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:49.792248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5aefd808-7804-4307-bad7-029f51bf5e5a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081593 Jun 24 09:18:49.792813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1539/2786] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:50.362112 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:50.362736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:50.369632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:50.370104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:50.370856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:50.371288 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:50.431011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:50.439235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:50.440735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:50.441909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f1c711f3-48c0-4ebc-a129-bd4aed19da5a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083610 Jun 24 09:18:50.442455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1248/2787] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:50.809570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:50.810217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:50.816627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:50.817071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:50.817856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:50.818295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:50.878509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:50.886272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-beba7092-6aa4-4725-8ee4-0cd60c5f102a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081215 Jun 24 09:18:50.886838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1540/2788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:51.460508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:51.461300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:51.467650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:51.468119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:51.468877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:51.469308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:51.533280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:51.542313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:51.543792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:51.544915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-30cf9482-2307-4c88-9a03-c8efbfc4f8bf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088471 Jun 24 09:18:51.545473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1249/2789] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:51.903610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:51.904218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:51.910626 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:51.911070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:51.911823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:51.912253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:51.971887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:51.980378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a66a0067-cb7d-4c92-8962-a37f4d627c79 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080691 Jun 24 09:18:51.980940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1541/2790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:52.563526 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:52.564128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:52.571177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:52.571647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:52.572433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:52.572867 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:52.632638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:52.641555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:52.643104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:52.644243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-660816e8-f76e-4f15-a1ae-387fd86684f8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084629 Jun 24 09:18:52.644800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1250/2791] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:52.998108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:52.998661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:53.004951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:53.005392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:53.006176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:53.006607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:53.065673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:53.073487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e6ef4a45-be34-4226-a8ca-b198bb68a9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079540 Jun 24 09:18:53.074078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1542/2792] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:53.661873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:53.662486 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:53.669928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:53.670375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:53.671130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:53.671564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:53.736706 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:53.745980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:53.747472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:53.748604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f5a32bc2-0a65-4a11-8ece-d9a3367b524a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090692 Jun 24 09:18:53.749156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1251/2793] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:54.090836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:54.091424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:54.097887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:54.098339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:54.099089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:54.099524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:54.160916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:54.169586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b466db0-7ae2-4c95-bb78-087fa261bb7d tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082603 Jun 24 09:18:54.170181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1543/2794] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:54.766094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:54.766713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:54.774022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:54.774468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:54.775216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:54.775641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:54.834529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:54.843605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:54.845094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:54.846249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-da99f449-9954-4dda-97fa-df56e05f4ca1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084243 Jun 24 09:18:54.846803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1252/2795] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:55.186468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:55.187069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:55.193467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:55.193944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:55.194691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:55.195747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:55.256917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:55.264876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f5fd2054-0063-4d07-a910-bb22040d1e41 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082209 Jun 24 09:18:55.265440 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1544/2796] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:55.864708 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:55.865245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:55.871814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:55.872268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:55.873037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:55.873477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:55.937564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:55.946562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:55.948107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:55.949250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-71fa36eb-2d1c-42b0-965d-f56adf166807 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088803 Jun 24 09:18:55.949837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1253/2797] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:56.281773 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:56.282388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:56.289354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:56.289851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:56.290609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:56.291048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:56.350036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:56.357971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cfc7a646-962c-4cb0-b232-f646482e54e3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080044 Jun 24 09:18:56.358564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1545/2798] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:56.966983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:56.967546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:56.974113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:56.974563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:56.975324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:56.975760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:57.035437 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:57.044490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:57.046011 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:57.047148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2e86c48a-b90f-454c-a6a7-17bc07d3e37f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084114 Jun 24 09:18:57.047746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1254/2799] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:57.374435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:57.375047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:57.381471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:57.381949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:57.382707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:57.383145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:57.441560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:57.449896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5cdf8ed0-0d5a-45ec-8b95-eaba44d15645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079263 Jun 24 09:18:57.450457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1546/2800] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:58.065776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:58.066384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:58.073512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:58.073987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:58.074743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:58.075177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:58.137781 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:58.146111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:58.147597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:58.148717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-da36e8a3-1e8d-4a58-91cc-802682215675 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086891 Jun 24 09:18:58.149267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1255/2801] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:58.466982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:58.467530 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:58.474057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:58.474511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:58.475271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:58.475711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:58.535837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:58.538289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:58.545175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ffc009ce-0499-46cb-aad4-7d126677a42b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082126 Jun 24 09:18:58.545755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1547/2802] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:18:59.167342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:59.167994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:59.174439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:59.174882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:59.175632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:59.176060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:59.190915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:59.237251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:59.246460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:59.248015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:59.249149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d8593c6d-c140-4707-834b-0fc0117b1aa4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086449 Jun 24 09:18:59.249928 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1256/2803] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:18:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:18:59.561932 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:18:59.562529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:18:59.568977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:59.569422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:59.570232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:18:59.570665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:18:59.629862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:18:59.637746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07226129-dce1-4b39-b6ec-ccf7027de9b2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079664 Jun 24 09:18:59.638302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1548/2804] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:18:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:00.267155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:00.267761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:00.270152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=54 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:00.276093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:00.276539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:00.277291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:00.277747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:00.339989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:00.348339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:00.349870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:00.351005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-aac569bd-bca8-4a4a-a436-a8f0bd024977 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087744 Jun 24 09:19:00.352194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1257/2805] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:00.655127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:00.655733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:00.662251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:00.662698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:00.663707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:00.664139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:00.723352 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:00.731259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b164a43e-03a3-409c-afa1-54c09f469bab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080015 Jun 24 09:19:00.731814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1549/2806] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:01.370076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:01.370684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:01.377130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:01.377572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:01.378360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:01.378788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:01.440015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:01.448273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:01.449769 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:01.450893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ab9ace1b-43b2-4865-ad02-8f90fbe92615 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085290 Jun 24 09:19:01.451438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1258/2807] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:01.748447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:01.749079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:01.755600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:01.756045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:01.756798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:01.757233 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:01.816306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:01.824726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de29b086-fd32-4aea-95a1-7a551f7a1bf1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080137 Jun 24 09:19:01.825284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1550/2808] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:02.468444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:02.469051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:02.475448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:02.475891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:02.477254 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:02.477709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:02.540058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:02.548249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:02.549763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:02.550890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f84cff69-05f6-4307-a43c-c206f24e00a1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086302 Jun 24 09:19:02.551441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1259/2809] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:02.841397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:02.842038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:02.848593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:02.849038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:02.849821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:02.850317 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:02.909858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:02.918436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-99800ee6-9ddc-4bc9-bfed-cd37bb1f247e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080911 Jun 24 09:19:02.918999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1551/2810] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:03.110800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:19:03.111013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:19:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:19:03.568886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:03.569544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:03.576792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:03.577236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:03.578028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:03.578468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:03.638998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:03.647320 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:03.649488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:03.650645 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1bcc6373-05c7-4b50-bbb4-dc2ae6ffa5e2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085750 Jun 24 09:19:03.651203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1260/2811] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:03.935705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:03.936311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:03.942767 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:03.943216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:03.943968 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:03.944401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:04.003595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:04.011972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-365c4f25-5c40-4f44-a7e1-affb72636cf4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080128 Jun 24 09:19:04.012529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1552/2812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:04.669111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:04.669760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:04.676394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:04.676737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:04.677505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:04.677970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:04.742512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:04.750847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:04.752334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:04.753476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f00c604e-e774-48ef-b2ed-8f269efe29ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088251 Jun 24 09:19:04.754103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1261/2813] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:05.028806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:05.029412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:05.035872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:05.036319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:05.037072 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:05.037499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:05.098443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:05.106253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c5b5be1a-39d2-4788-b347-b377d495d3b7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081315 Jun 24 09:19:05.106811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1553/2814] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:05.771793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:05.772406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:05.779027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:05.779478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:05.780245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:05.780683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:05.841972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:05.850423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:05.852423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:05.853549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7508e267-dc32-4ea6-b1b0-9f8e59ee79a0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085742 Jun 24 09:19:05.854137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1262/2815] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:06.122999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:06.123689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:06.130606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:06.131052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:06.131805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:06.132229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:06.192957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:06.200771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3622208b-c2ef-461f-8e70-514e6006dbb4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081680 Jun 24 09:19:06.201326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1554/2816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:06.872167 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:06.872776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:06.879237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:06.879687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:06.880450 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:06.880884 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:06.943135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:06.952134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:06.953623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:06.954774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2d6b5e9d-3ca5-4f7a-a117-c7cbdd983c0b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086503 Jun 24 09:19:06.955333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1263/2817] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:07.218381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:07.218989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:07.225499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:07.225986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:07.226775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:07.227210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:07.286074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:07.294153 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1ab38af-a43e-468e-87db-0a76acd0be58 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079640 Jun 24 09:19:07.294711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1555/2818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:07.972484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:07.973041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:07.979532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:07.979981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:07.980737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:07.981171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:08.043463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:08.051718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:08.053205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:08.054391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ddaf6de0-b0c5-4325-882d-92fb63898dfe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085946 Jun 24 09:19:08.054956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1264/2819] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:08.166160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:19:08.166351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:19:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:19:08.311154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:08.311756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:08.318198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:08.318639 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:08.319384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:08.320427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:08.378758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:08.387205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cd1ed1ba-77a6-4e48-a5ff-969d3260559a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079917 Jun 24 09:19:08.387763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1556/2820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:09.073137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:09.073875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:09.080360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:09.080814 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:09.081572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:09.082031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:09.144596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:09.152829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:09.154361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:09.155487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-993b6dc5-80c3-43e9-8b41-41fecb5b3def tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086993 Jun 24 09:19:09.156035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1265/2821] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:09.403257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:09.403820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:09.410410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:09.410866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:09.411719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:09.412154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:09.473818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:09.482470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-488c3bb4-7b4c-4987-9d7a-ceeeb57b38a7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083152 Jun 24 09:19:09.483028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1557/2822] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:10.173816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:10.174456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:10.181435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:10.181918 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:10.182672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:10.183107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:10.244334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:10.252854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:10.254371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:10.255504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-648de745-2063-447a-bef3-b8171f8dadf2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085603 Jun 24 09:19:10.256084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1266/2823] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:10.499258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:10.499800 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:10.502113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:10.507294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:10.507740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:10.508519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:10.508946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:10.568272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:10.575980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2efb58e6-0a47-4821-9f2d-fc0479ecf114 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080650 Jun 24 09:19:10.576532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1558/2824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:11.207067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:19:11.207327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:19:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:19:11.273917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:11.274618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:11.281199 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:11.281965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:11.282738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:11.283173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:11.347373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:11.361714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:11.364034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:11.365853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f19c11e4-2ba4-41c7-b1fa-b81d0f9a774e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.095471 Jun 24 09:19:11.366917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1267/2825] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:11.592677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:11.593290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:11.600134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:11.600534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:11.602000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:11.602438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:11.661777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:11.670753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e14520c5-746d-423c-953d-8477a4bb7f14 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081994 Jun 24 09:19:11.671318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1559/2826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:12.384621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:12.385245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:12.391763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:12.392217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:12.392966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:12.393414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:12.455357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:12.463754 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:12.465239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:12.466403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-699a7aca-cdb5-4aaa-a69b-20e894e9b708 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086294 Jun 24 09:19:12.466965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1268/2827] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:12 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:12.687757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:12.688289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:12.694924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:12.695373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:12.696128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:12.697073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:12.756224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:12.764540 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e1ee9a52-729a-41b6-9f59-c5803d880424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080752 Jun 24 09:19:12.765100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1560/2828] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:12 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:13.484627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:13.485184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:13.491675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:13.492126 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:13.492893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:13.493936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:13.559585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:13.568093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:13.569589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:13.570762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cbfda2d2-3092-43af-9c44-4f22b8691de0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090117 Jun 24 09:19:13.571321 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1269/2829] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:13.781399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:13.782040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:13.788464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:13.788911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:13.789679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:13.790739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:13.849201 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:13.857726 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f8086434-62fd-4d1b-a2fb-afc203a93032 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080222 Jun 24 09:19:13.858281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1561/2830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:14.588384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:14.588997 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:14.595477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:14.595927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:14.596684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:14.597118 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:14.660777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:14.670077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:14.671609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:14.672751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-43e965d4-d234-4e35-9a3c-2f6c37bccc4c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088299 Jun 24 09:19:14.673310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1270/2831] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:14.875291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:14.875905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:14.882433 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:14.882891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:14.883653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:14.884090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:14.944917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:14.952788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d11bd024-9685-4d48-a623-63fba3318ff4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081500 Jun 24 09:19:14.953350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1562/2832] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:15.691457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:15.692072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:15.699048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:15.699497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:15.700253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:15.700685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:15.763325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:15.771633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:15.773132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:15.774924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-be867b1c-0448-4af8-9d15-68f871459186 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086733 Jun 24 09:19:15.775477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1271/2833] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:15.969509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:15.970094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:15.976453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:15.976902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:15.977649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:15.978101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:16.043481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:16.051220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06f41b11-2575-4ce7-ae29-2a96492e0855 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085591 Jun 24 09:19:16.051774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1563/2834] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:16.793180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:16.793875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:16.800367 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:16.800813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:16.801571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:16.802033 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:16.861834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:16.870102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:16.871601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:16.872742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-32f59ba8-ad0e-470e-bca6-ebc7e2b46eb3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084026 Jun 24 09:19:16.873296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1272/2835] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:17.068125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:17.068760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:17.075833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:17.076331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:17.077086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:17.077512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:17.092736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:17.137070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:17.144959 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ab2824d2-74f9-48fd-86da-92dbbee36645 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080654 Jun 24 09:19:17.145514 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1564/2836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:17.890959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:17.891498 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:17.897933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:17.898384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:17.899141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:17.900148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:17.904038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:17.962874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:17.971187 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:17.972681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:17.973859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7bcfef8b-0bdf-4491-88d1-cf53a874004d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086963 Jun 24 09:19:17.974412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1273/2837] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:19:18.161871 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:18.162439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:18.168998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:18.169555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:18.170223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:18.170686 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:18.229533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:18.237304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-268ae895-88ce-45a1-9ed3-4bf238889cf3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079395 Jun 24 09:19:18.237894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1565/2838] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:18.991886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:18.992457 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:18.998826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:18.999279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:19.000038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:19.000476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:19.060979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:19.070417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:19.071905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:19.073047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-40c958c9-3f75-4760-b05b-07901e6501f1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085249 Jun 24 09:19:19.073600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1274/2839] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:19.254701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:19.255252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:19.261682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:19.262156 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:19.262937 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:19.263373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:19.322664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:19.330445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3f84139-0c63-4760-b1a5-5acac960cf45 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079641 Jun 24 09:19:19.331002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1566/2840] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:20.091573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:20.092188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:20.098209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:20.098654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:20.099405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:20.099834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:20.162335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:20.170930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:20.172427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:20.173559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2c76c2cb-974b-4b72-a8bd-1575f95f524f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086701 Jun 24 09:19:20.174144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1275/2841] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:20.347315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:20.347877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:20.354279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:20.354722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:20.355471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:20.355933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:20.414900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:20.422653 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d78b0f3c-56c0-4f36-ac98-5ebef701eecb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079273 Jun 24 09:19:20.423205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1567/2842] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:21.191208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:21.191822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:21.199098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:21.199549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:21.200314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:21.200752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:21.261091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:21.269413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:21.270951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:21.272103 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-89a1f0a7-fbce-4b99-bf31-af013dc95731 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084778 Jun 24 09:19:21.272659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1276/2843] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:21.440122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:21.440727 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:21.447866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:21.448258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:21.449003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:21.449435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:21.508071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:21.516351 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba62a890-cc6a-407e-896a-aaae62f12176 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080146 Jun 24 09:19:21.516911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1568/2844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:22.290900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:22.291512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:22.298077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:22.298528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:22.299294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:22.299731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:22.364471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:22.373382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:22.374892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:22.376024 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ec4dd1a-964d-44d8-8447-1aa2a9d76201 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089803 Jun 24 09:19:22.376577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1277/2845] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:22 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:22.533640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:22.534290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:22.541699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:22.542085 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:22.542833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:22.543263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:22.601747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:22.610325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fb3d5d7a-e327-4ee6-b6d4-c68d57c6612c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080544 Jun 24 09:19:22.610883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1569/2846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:23.393016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:23.393640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:23.400671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:23.401122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:23.401911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:23.402350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:23.462237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:23.470546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:23.471982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:23.473123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0f311d48-dbc5-4331-8182-92915c71a576 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083993 Jun 24 09:19:23.473703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1278/2847] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:23.627162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:23.627772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:23.634286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:23.634764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:23.635518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:23.635953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:23.695645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:23.703991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ac706c23-85d3-4c64-b951-93e860a57dda tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080705 Jun 24 09:19:23.704582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1570/2848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:24.491830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:24.492452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:24.499533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:24.499984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:24.500742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:24.501178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:24.564577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:24.572903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:24.574428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:24.575578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d0c48ec4-bc46-413d-9912-f9c84e3eb8bd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087674 Jun 24 09:19:24.576136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1279/2849] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:24.721430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:24.722095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:24.728985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:24.729430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:24.730205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:24.730630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:24.791083 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:24.798965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d8b965fe-d29c-4ac9-a930-754e3024528c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081502 Jun 24 09:19:24.799517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1571/2850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:24 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:25.593050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:25.593644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:25.600159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:25.600604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:25.601361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:25.601823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:25.661802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:25.670403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:25.671875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:25.672995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8cafbd07-0ecf-4641-84f2-35ba3f3b2d33 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083894 Jun 24 09:19:25.673548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1280/2851] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:25.815619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:25.816228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:25.823203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:25.823649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:25.824401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:25.824833 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:25.885740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:25.893824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-00eb9216-f974-4e0b-b0b5-b8263002d57b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082016 Jun 24 09:19:25.894393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1572/2852] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:26.692571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:26.693179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:26.700881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:26.701324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:26.702119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:26.702535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:26.765221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:26.773464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:26.775014 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:26.776136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c783773-1ff0-458f-91fd-6a483fb5c474 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088405 Jun 24 09:19:26.776693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1281/2853] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:26.910467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:26.910980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:26.918253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:26.918693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:26.919438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:26.919865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:26.979922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:26.987730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-13191412-ebbe-43c1-ba95-932667736b87 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081121 Jun 24 09:19:26.988289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1573/2854] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:27.794314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:27.794924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:27.801322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:27.801806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:27.802570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:27.803006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:27.862710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:27.871327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:27.872819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:27.873980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-db9d1698-f683-4adf-befd-6688da0efb59 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083614 Jun 24 09:19:27.874543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1282/2855] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:28.004165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:28.004789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:28.011917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:28.012404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:28.013167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:28.013602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:28.080607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:28.088613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d153e82b-678b-4d5a-9f67-805d4b7afd0e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088267 Jun 24 09:19:28.089179 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1574/2856] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:28.892023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:28.892554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:28.899035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:28.899493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:28.900252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:28.900682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:28.963195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:28.971632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:28.973133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:28.974304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5efba4f7-5cc8-4a62-a077-bc262393f990 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086364 Jun 24 09:19:28.974873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1283/2857] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:29.105036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:29.105649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:29.112215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:29.112668 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:29.113435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:29.113902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:29.174915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:29.183469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1e8546c-5939-4a60-9de3-2834f18e949f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082839 Jun 24 09:19:29.184037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1575/2858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:29.994273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:29.994914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:30.001189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:30.001642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:30.002416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:30.002846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:30.071440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:30.080419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:30.081943 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:30.083073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96dc98be-21de-4b93-be53-d4b0ce35b36f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.092776 Jun 24 09:19:30.083635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1284/2859] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:30.200529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:30.201136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:30.207595 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:30.208038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:30.208785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:30.209211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:30.268905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:30.276821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cb9f4ba8-24fb-4a90-b2eb-e3d087ee12e6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080662 Jun 24 09:19:30.277382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1576/2860] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:31.100439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:31.101052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:31.103975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=56 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:31.109343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:31.109826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:31.110591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:31.111027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:31.173626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:31.182077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:31.183581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:31.184715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0079d488-6a85-4d94-80b2-ed989e560436 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088204 Jun 24 09:19:31.185270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1285/2861] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:31.294045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:31.294654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:31.301149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:31.301623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:31.302407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:31.302837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:31.362168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:31.370060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b1a50bd-feb0-440a-a543-4da227af8c2a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079934 Jun 24 09:19:31.370622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1577/2862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:32.202682 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:32.203277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:32.210039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:32.210489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:32.211242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:32.211672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:32.271035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:32.280590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:32.282241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:32.283630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e96f2bb-1f98-4f5d-ae0c-d77656793758 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084903 Jun 24 09:19:32.284183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1286/2863] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:32.386128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:32.386737 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:32.393636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:32.394105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:32.394887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:32.395314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:32.456673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:32.465143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a440767e-bcd1-438d-8b68-24691b3046b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082851 Jun 24 09:19:32.465807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1578/2864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:33.303046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:33.303664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:33.310784 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:33.311469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:33.312309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:33.312741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:33.375145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:33.383341 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:33.385479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:33.386638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0cc152e6-fe6d-4f42-84e5-9fd8918cbe4b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087531 Jun 24 09:19:33.387197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1287/2865] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:33 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:33.482152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:33.482708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:33.489236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:33.489707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:33.490478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:33.490915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:33.549831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:33.558315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-eb068d2c-7bdc-43c1-9150-5b75edd9dc80 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080541 Jun 24 09:19:33.558872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1579/2866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:34.404963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:34.405557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:34.412040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:34.412491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:34.413504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:34.413966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:34.473362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:34.481695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:34.483185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:34.484313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5b5da0dd-623b-4c22-97c4-42e65c7336b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083235 Jun 24 09:19:34.484873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1288/2867] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:34.575368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:34.575979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:34.582489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:34.582938 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:34.583691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:34.584133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:34.642969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:34.650849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-84540c06-0602-4dca-a448-563f14f5e795 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079863 Jun 24 09:19:34.651407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1580/2868] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:35.501921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:35.502494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:35.509108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:35.509564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:35.510344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:35.510777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:35.578425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:35.580622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:35.588717 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:35.591065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:35.592936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6d683bf8-d164-44f4-b16d-95470d2659ce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.094672 Jun 24 09:19:35.593988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1289/2869] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:35.668282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:35.668889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:35.675430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:35.675874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:35.676628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:35.677065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:35.679631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:35.742200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:35.752691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0841e5fd-f0bb-44a4-ad9c-5416de1bb108 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088252 Jun 24 09:19:35.753236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1581/2870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:35 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:36.615725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:36.616331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:36.623422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:36.623862 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:36.624618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:36.625050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:36.686642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:36.694752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:36.696295 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:36.697410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3f9fb820-3c1c-49b1-8bb3-b434be6283d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085631 Jun 24 09:19:36.698003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1290/2871] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:36.769812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:36.770414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:36.777267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:36.777734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:36.778480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:36.778914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:36.839457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:36.847306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-08979180-c792-4243-b549-25eeaf2e86e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081381 Jun 24 09:19:36.847870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1582/2872] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:37.715385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:37.715986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:37.722521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:37.722964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:37.723720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:37.724147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:37.786850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:37.795428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:37.796909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:37.798067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a439a5fc-0b15-4d04-9eff-1d2df47b0ef9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086689 Jun 24 09:19:37.798620 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1291/2873] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:37.864193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:37.864795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:37.871804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:37.872190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:37.872962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:37.873393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:37.933565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:37.941386 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-db00048c-1530-48df-9907-b306a5413584 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081043 Jun 24 09:19:37.941984 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1583/2874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:38.816633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:38.817302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:38.824273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:38.824720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:38.825492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:38.825955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:38.897973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:38.907220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:38.908735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:38.909910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-387b64fe-0de4-47b8-8335-076f5c592ebe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.097398 Jun 24 09:19:38.910470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1292/2875] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:38.957196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:38.957834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:38.964885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:38.965338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:38.966133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:38.966576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:39.025705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:39.033608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0f68b386-de4f-4017-aa0a-4c6c39694024 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080240 Jun 24 09:19:39.034202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1584/2876] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:39.928121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:39.928802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:39.935309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:39.935760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:39.936516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:39.936956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:40.005141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:40.015124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:40.016666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:40.018471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-87870a24-00db-4d32-8b82-fb15e568b4dd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.094378 Jun 24 09:19:40.019060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1293/2877] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:40.050837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:40.051474 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:40.057990 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:40.058443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:40.059196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:40.059630 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:40.119734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:40.127604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ec0dec15-e93d-4512-b216-f5a2230791e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080644 Jun 24 09:19:40.128169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1585/2878] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:41.036393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:41.037005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:41.044309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:41.044763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:41.045522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:41.045994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:41.105475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:41.113762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:41.115265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:41.116403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2868172d-ad92-44f3-a40d-8a99da8199ca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083891 Jun 24 09:19:41.116952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1294/2879] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:41.144162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:41.144761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:41.147099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:41.153168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:41.153614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:41.154385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:41.154814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:41.214347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:41.222071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48a7e6ec-106c-4a17-8f56-65310f1e335c tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081790 Jun 24 09:19:41.222631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1586/2880] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:42.135116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:42.135664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:42.142063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:42.142508 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:42.143257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:42.143684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:42.205919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:42.214729 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:42.216223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:42.217343 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dd74df03-2877-4a26-9f20-d9dd3b6d0c9a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086279 Jun 24 09:19:42.217940 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1295/2881] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:42.238601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:42.239211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:42.245570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:42.246055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:42.246809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:42.247246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:42.306723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:42.314648 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6fbb3ca2-d058-4c7b-972f-36ab6efb2bd1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079862 Jun 24 09:19:42.315222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1587/2882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:43.234819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:43.235471 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:43.241875 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:43.242316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:43.243073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:43.244102 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:43.303232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:43.312186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:43.313685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:43.314831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6de1ac60-86a8-4b21-9d3e-93147fd02915 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083996 Jun 24 09:19:43.315387 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1296/2883] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:43 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:19:43.331517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:43.332134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:43.338266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:43.338717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:43.339461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:43.339894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:43.398403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:43.406174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-25139d47-760f-423a-a2a4-47016677851b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.078528 Jun 24 09:19:43.406757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1588/2884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:44.332469 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:44.333057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:44.340272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:44.340718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:44.341473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:44.341950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:44.407504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:44.416625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:44.418133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:44.419563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ac509590-d617-4649-bcf5-26154411343c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090795 Jun 24 09:19:44.420316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1297/2885] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:44.424431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:44.425142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:44.431645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:44.432097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:44.432863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:44.433300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:44.492460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:44.500407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e247946b-3a96-4b4a-868c-601260864e95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079902 Jun 24 09:19:44.501013 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1589/2886] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:45.437789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:45.438386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:45.444731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:45.445175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:45.445956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:45.446441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:45.506058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:45.514353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:45.516211 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:45.517376 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-134f278e-1f8a-45ce-b766-7da08bab174b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083468 Jun 24 09:19:45.517499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:45.518059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:45.518256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1298/2887] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:45.524560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:45.525016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:45.525809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:45.526274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:45.585803 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:45.593545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e65bfe88-62c3-4b51-b978-777695b83df6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080130 Jun 24 09:19:45.594137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1590/2888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:46.534563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:46.535155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:46.542237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:46.542684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:46.543494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:46.543865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:46.606191 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:46.610393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:46.611128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:46.614826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:46.616309 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:46.617444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c7b1abab-b2b9-452f-b9a9-4d011995e9e5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086757 Jun 24 09:19:46.617574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:46.617975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:46.618136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1299/2889] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:46.619243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:46.619857 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:46.679094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:46.687466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-32982bf8-08b7-48ce-87f8-f3c2a9871049 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080876 Jun 24 09:19:46.688037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1591/2890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:46 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:47.638061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:47.638939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:47.646737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:47.647278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:47.648219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:47.648741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:47.704560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:47.705310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:47.709510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:47.712023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:47.713002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:47.713798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:47.714245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:47.719301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:47.720241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:47.721394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f74428a9-89b5-47d2-89cc-eef8000d89b2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089424 Jun 24 09:19:47.721990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1300/2891] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:47.774253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:47.782576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-03dcf3be-3e49-4927-b7de-be39ad9b5918 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082091 Jun 24 09:19:47.783130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1592/2892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:48.739142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:48.739681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:48.746675 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:48.747125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:48.747873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:48.748302 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:48.800071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:48.800672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:48.807120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:48.807564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:48.808314 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:48.809168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:48.811207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:48.819613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:48.821100 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:48.822263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f1de0ddb-bcd0-47e8-9539-bbcb0855338a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087093 Jun 24 09:19:48.823614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1301/2893] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:48.873960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:48.881732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7f9a91d2-0c5a-425b-8507-8fa814c1e271 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085584 Jun 24 09:19:48.882295 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1593/2894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:49.840559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:49.841162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:49.847141 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:49.847581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:49.848345 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:49.848755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:49.897935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:49.898486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:49.904861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:49.905318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:49.906180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:49.906548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:49.908284 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:49.917554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:49.919075 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:49.920351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6fe748eb-87ad-4c07-ba67-cface3d437d6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083817 Jun 24 09:19:49.920917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1302/2895] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:49.966361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:49.974384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-68b9cb1a-6792-48e0-a938-5f9eac66aca6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080463 Jun 24 09:19:49.974986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1594/2896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:50.939078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:50.939639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:50.946737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:50.947176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:50.947930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:50.948362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:50.991743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:50.992339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:50.998927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:50.999375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:51.000161 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:51.000592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:51.011223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:51.019598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:51.021095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:51.022290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e528f215-15ef-4bd4-9ee0-64955acb7e9f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087151 Jun 24 09:19:51.022850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1303/2897] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:51.060922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:51.068744 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ab63448f-0fee-40b4-944c-110a7a644b95 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080889 Jun 24 09:19:51.069302 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1595/2898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:52.042127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:52.042735 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:52.049397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:52.049915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:52.050668 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:52.051098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:52.086053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:52.086642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:52.093579 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:52.094062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:52.094824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:52.095256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:52.113596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:52.123983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:52.126354 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:52.127873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f3f38d03-2f0f-4568-bc92-4ce736cf839c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090476 Jun 24 09:19:52.128481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1304/2899] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:52.157509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:52.165672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4fdfb5bb-b54c-46ce-ab79-670c94ce2f07 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.083411 Jun 24 09:19:52.166239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1596/2900] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:53.146551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:53.147186 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:53.153858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:53.154315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:53.155083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:53.155539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:53.182988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:53.183628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:53.190099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:53.190554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:53.191307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:53.191745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:53.218596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:53.227130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:53.229146 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:53.230325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c90b8646-15bb-4411-b11b-f5021883f4e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087710 Jun 24 09:19:53.231077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1305/2901] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:53.251920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:53.254113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:53.261016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07db421e-d3f0-4b80-8d82-b7de35f3e5c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082507 Jun 24 09:19:53.261591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1597/2902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:54.248772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:54.249364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:54.255777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:54.256215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:54.256962 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:54.257388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:54.272535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:19:54.278299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:54.278905 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:54.285425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:54.285900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:54.286659 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:54.287092 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:54.318815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:54.327984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:54.329477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:54.330644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-58bb4f35-4b1c-44ae-9088-22e48c213399 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085739 Jun 24 09:19:54.331196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1306/2903] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:54 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:54.347068 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:54.354917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ebc0033d-f12a-4e29-9257-d0ed62029ea7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080594 Jun 24 09:19:54.355467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1598/2904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:55.348632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:55.349236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:55.363039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:55.363039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:55.363739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:55.364185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:55.372689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:55.373291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:55.380976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:55.381424 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:55.382224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:55.382654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:55.430310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:55.438831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:55.440332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:55.441478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-632bd8fc-6970-4fca-939d-08cb8a573bb8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.096831 Jun 24 09:19:55.442277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1307/2905] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:19:55.455701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:55.464304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ba7a8626-8dd2-42d3-b27f-b2602ee9c0ba tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.096223 Jun 24 09:19:55.464873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1599/2906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:56.460056 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:56.460657 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:56.467637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:56.468084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:56.468839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:56.469273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:56.481315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:56.481953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:56.488470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:56.488854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:56.489617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:56.490081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:56.532113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:56.541512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:56.543038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:56.544179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c09933fb-c38a-481d-8d3e-60345f04c128 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088041 Jun 24 09:19:56.544734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1308/2907] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:56.557874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:56.565763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-011c4fe5-463f-40f7-8c33-350c5f9fd1eb tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088912 Jun 24 09:19:56.566325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1600/2908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:57.562676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:57.563294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:57.569863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:57.570317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:57.571098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:57.571540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:57.582411 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:57.583047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:57.589651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:57.590120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:57.590875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:57.591309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:57.637410 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:57.646525 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:57.648242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:57.649396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c757a03b-5de4-40f0-882d-143763a8a672 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090663 Jun 24 09:19:57.649984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1309/2909] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:57.663623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:57.672243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4e70e645-1901-462d-88ef-80fc3b4a7dd9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.093620 Jun 24 09:19:57.672802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1601/2910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:19:58.667744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:58.668356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:58.674848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:58.675296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:58.676060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:58.676492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:58.689327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:58.689962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:58.696957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:58.697408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:58.698198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:58.698635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:58.741279 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:58.750332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:58.751819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:58.752968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-57c0792b-b8ed-4a6a-90f9-53e67c1790ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089572 Jun 24 09:19:58.753537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1310/2911] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:58.767837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:58.775847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f83a1b86-a34f-4de8-a094-9fb8b47560c1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090302 Jun 24 09:19:58.776404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1602/2912] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:58 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:19:59.771679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:59.772303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:59.779430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:59.779871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:59.780624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:59.781050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:59.792307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:19:59.792917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:19:59.799252 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:59.799694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:59.800442 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:19:59.800870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:19:59.843899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:59.852582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:59.854099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:59.855249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cd67b872-f544-4882-94a7-c047a245ba53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087486 Jun 24 09:19:59.855808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1311/2913] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:19:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:19:59.871978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:19:59.879898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1cf7fdd2-80d4-4013-9b33-2a85f633548e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.091627 Jun 24 09:19:59.880449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1603/2914] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:19:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:00.872923 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:00.873499 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:00.879992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:00.880442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:00.881202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:00.881637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:00.896168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:00.896774 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:00.903285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:00.903734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:00.904499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:00.904935 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:00.944063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:00.953166 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:00.954705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:00.955852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9ff5868e-f22f-4fa9-8e28-d3d0eb172c34 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086928 Jun 24 09:20:00.956406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1312/2915] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:00.969728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:00.977817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7dc171d8-d7e8-4d78-8ab2-0d9d60123f5f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.085465 Jun 24 09:20:00.978381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1604/2916] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:01.974115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:01.974664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:01.977052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=56 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:01.982314 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:01.982768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:01.983535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:01.983971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:01.994500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:01.995106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:02.001571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:02.002125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:02.002879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:02.003307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:02.046638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:02.055257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:02.056789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:02.057969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7ab9a25-b6be-442b-a268-f575906ed172 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087788 Jun 24 09:20:02.058529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1313/2917] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:02.072839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:02.080777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a1ffc845-e983-462a-ab74-aaf7656111c3 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090078 Jun 24 09:20:02.081331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1605/2918] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:03.075980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:03.076598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:03.083152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:03.083604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:03.084364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:03.084801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:03.098073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:03.098687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:03.105623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:03.106110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:03.106910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:03.107348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:03.150135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:03.158756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:03.160253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:03.161393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f829670a-f7b8-4c12-a96a-699c0a4a2edf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089357 Jun 24 09:20:03.161994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1314/2919] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:20:03.176758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:03.184578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-340235a7-995a-475c-b0cd-b2b84556c9d6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090338 Jun 24 09:20:03.185137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1606/2920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:04.180316 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:04.181156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:04.187937 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:04.188381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:04.189180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:04.189611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:04.201591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:04.202220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:04.208607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:04.209057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:04.209919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:04.210379 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:04.252259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:04.261256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:04.262793 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:04.263951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-33be8bbe-1823-49b7-86cc-6646c771a411 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087602 Jun 24 09:20:04.264517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1315/2921] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:04.278365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:04.286262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-48f4e514-d25c-4f73-a749-346397a9271e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088483 Jun 24 09:20:04.286815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1607/2922] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:05.282722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:05.283328 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:05.290070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:05.290519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:05.291269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:05.291702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:05.303048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:05.303656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:05.310560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:05.311028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:05.311783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:05.312212 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:05.356736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:05.365244 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:05.366762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:05.368430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d7e8746e-6486-4ea0-ada7-61d30b787471 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089136 Jun 24 09:20:05.368995 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1316/2923] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:05 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:05.382798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:05.391301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-31d89b9a-cd72-4142-bb84-4969bd390928 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.092075 Jun 24 09:20:05.391856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1608/2924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:06.386964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:06.387577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:06.394058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:06.394505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:06.395263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:06.395701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:06.408205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:06.408819 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:06.415517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:06.416423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:06.416729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:06.417149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:06.460072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:06.469277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:06.470818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:06.471969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-325bf5ea-361e-423c-9636-db801ae1a058 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089519 Jun 24 09:20:06.472530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1317/2925] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:06 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:06.486325 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:06.494733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b381f112-1ae7-4369-8516-39c43f52b303 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090322 Jun 24 09:20:06.495315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1609/2926] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:06 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:07.490467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:07.491032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:07.498098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:07.498551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:07.499313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:07.499749 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:07.511674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:07.512275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:07.519203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:07.519646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:07.520398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:07.520827 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:07.562386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:07.570925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:07.572419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:07.573572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-570f3f13-cd90-4275-ab71-e94a441bfcce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087225 Jun 24 09:20:07.574172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1318/2927] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:07 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:07.590755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:07.598622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cd585f4e-0d9a-4c28-8357-8b8388c35932 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.090775 Jun 24 09:20:07.599237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1610/2928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:07 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:08.592348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:08.592936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:08.599385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:08.599829 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:08.600587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:08.601021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:08.616031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:08.616980 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:08.623590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:08.624040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:08.624808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:08.625281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:08.667095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:08.675677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:08.677196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:08.678370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-079cec80-08bd-4a4b-b43f-4d6501a0c0b7 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090250 Jun 24 09:20:08.678921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1319/2929] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:08 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:08.693448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:08.701976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d7b01199-0d7f-4de5-8e57-76723274f6d9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.089869 Jun 24 09:20:08.702535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1611/2930] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:08 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:09.696267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:09.696880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:09.703396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:09.703849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:09.704611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:09.705048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:09.718423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:09.719059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:09.725534 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:09.726016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:09.726812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:09.727746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:09.768247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:09.778043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:09.780533 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:09.782044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8a2e6814-522f-44b8-9bc2-c26398d2251f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089623 Jun 24 09:20:09.783028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1320/2931] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:09 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:09.800606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:09.808705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a10cf651-93ce-46ba-bfde-ef9e5ac3818a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.094099 Jun 24 09:20:09.809272 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1612/2932] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:09 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:10.800989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:10.801601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:10.808577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:10.809029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:10.809820 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:10.810261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:10.826018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:10.826682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:10.833027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:10.833471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:10.834324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:10.834755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:10.876966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:10.886404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:10.887890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:10.889026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-55742225-6078-40cd-ab34-4219cbe4fb53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.092010 Jun 24 09:20:10.889811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1321/2933] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:10 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:10.902753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:10.910707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7a19ee85-9e08-4455-b139-d84f3fe08f82 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.088458 Jun 24 09:20:10.911276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1613/2934] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:10 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:11.907786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:11.908504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:11.915162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:11.916235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:11.917022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:11.917472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:11.928104 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:11.928711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:11.931096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:11.936283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:11.937029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:11.938060 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:11.938495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:11.955245 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:11.984591 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:11.995090 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:11.996618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:11.998001 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7390e95c-010c-4925-9b25-5324b69b2725 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.094760 Jun 24 09:20:11.999468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1322/2935] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:11 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:12.013382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:12.022038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fb7ea2e8-e7e5-436c-b10a-cd33a2165149 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.097737 Jun 24 09:20:12.022628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1614/2936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:11 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:13.015865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:13.016456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:13.022925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:13.023537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:13.024294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:13.025236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:13.029073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:13.038965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:13.039605 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:13.046262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:13.046706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:13.047461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:13.047889 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:13.093082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:13.101775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:13.103840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:13.104985 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fcb896f1-022b-40a8-b41f-a019fddc929c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.093038 Jun 24 09:20:13.105541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1323/2937] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:13 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:13.118815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:13.126876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1159cfec-b216-489f-bdee-afe651b47acd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.092047 Jun 24 09:20:13.127430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1615/2938] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:13 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:14.123150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:14.123761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:14.130326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:14.130775 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:14.131534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:14.131968 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:14.143431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:14.144044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:14.151608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:14.152062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:14.152841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:14.153277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:14.218516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:14.226873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ee1731b9-e8df-4140-bff2-32d59483b1c9 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.087126 Jun 24 09:20:14.227462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1616/2939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:14 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:14.343050 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:14.351350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:14.352865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:14.354026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-822f224a-bd0f-4d1d-94a6-fdd0ef3333eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.234734 Jun 24 09:20:14.354584 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1324/2940] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:14 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:15.245868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:15.246490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:15.253035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:15.253481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:15.254264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:15.254694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:15.313733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:15.321558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-17096144-7abc-4da5-bf7d-4f5007e4d7dd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079506 Jun 24 09:20:15.322420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1617/2941] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:15 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:15.371487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:15.372099 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:15.378561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:15.379016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:15.379808 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:15.380247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:15.443064 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:15.452144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:15.453626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:15.454788 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a13f772e-e7ed-4528-91fd-80ce59657170 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087155 Jun 24 09:20:15.455331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1325/2942] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:15 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:20:16.338505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:16.339113 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:16.345573 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:16.346047 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:16.346796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:16.347225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:16.406405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:16.414839 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e1321e7d-d5cb-4f3f-b01b-4103d0bef6e8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080256 Jun 24 09:20:16.415899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1618/2943] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:16 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:16.473351 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:16.474028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:16.480956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:16.481411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:16.482216 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:16.482656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:16.542817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:16.551158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:16.552658 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:16.553830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3ae57019-abb0-4f79-acdf-e2be2c5844e1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084286 Jun 24 09:20:16.554371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1326/2944] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:16 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:17.432527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:17.433069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:17.439551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:17.440001 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:17.440757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:17.441187 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:17.500413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:17.508231 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e771b568-57a6-4bf9-a955-10df2a67cfdc tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080155 Jun 24 09:20:17.508798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1619/2945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:17 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:17.572386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:17.572990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:17.579371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:17.579816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:17.580582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:17.581020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:17.643042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:17.651510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:17.653004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:17.654183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d4e18818-c466-474c-aab0-558d7b2985b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086320 Jun 24 09:20:17.654742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1327/2946] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:17 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:18.526244 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:18.526849 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:18.533745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:18.534200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:18.534954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:18.535389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:18.596262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:18.604111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-45f63d3e-74bd-4dd1-a852-c0ce31ea3cb5 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082412 Jun 24 09:20:18.604674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1620/2947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:18 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:18.673908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:18.674522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:18.681043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:18.681495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:18.682304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:18.682736 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:18.742005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:18.750876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:18.752363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:18.753500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a09b4979-6f10-4fee-a3ed-860355cca11a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083572 Jun 24 09:20:18.754096 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1328/2948] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:19.620818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:19.621427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:19.627954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:19.628401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:19.629157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:19.629590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:19.688383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:19.696150 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2e6f8536-389f-4d94-aecc-2a9127a83bfd tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079177 Jun 24 09:20:19.696707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1621/2949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:19 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:19.771595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:19.772227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:19.778711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:19.779153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:19.779912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:19.780342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:19.848000 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:19.857124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:19.858597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:19.859734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c46691a1-fa82-4203-964b-8160d8dab975 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.092184 Jun 24 09:20:19.860290 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1329/2950] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:19 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:20.712111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:20.712713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:20.719242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:20.719687 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:20.720447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:20.720880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:20.780174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:20.787983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b8bf94b8-0084-41ce-a9c5-24fc034e4751 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079787 Jun 24 09:20:20.788810 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1622/2951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:20 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:20.877627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:20.878181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:20.884594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:20.885037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:20.885823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:20.886266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:20.947047 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:20.955221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:20.956711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:20.957865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a5e183f1-f9d4-40dc-8b7f-42b154ac0808 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084151 Jun 24 09:20:20.958409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1330/2952] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:20 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:21.806018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:21.807129 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:21.813570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:21.814058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:21.814817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:21.815254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:21.877811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:21.886391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9f46dd37-2e72-4377-83f8-36df6884cb3b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084342 Jun 24 09:20:21.886956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1623/2953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:21 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:21.975869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:21.976478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:21.983125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:21.983574 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:21.984329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:21.984767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:22.047370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:22.055677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:22.057713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:22.058846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2c49c5e4-9878-4d3f-afe6-65dc2e5eafeb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087025 Jun 24 09:20:22.059391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1331/2954] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:21 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:22.903713 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:22.904329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:22.910754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:22.911200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:22.911960 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:22.912378 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:22.971278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:22.979173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3f017c6c-8238-4376-bfd2-2b6d73c2c26a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079955 Jun 24 09:20:22.979731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1624/2955] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:22 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:23.076666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:23.077280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:23.083734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:23.084189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:23.084956 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:23.085394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:23.145038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:23.154210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:23.155661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:23.156798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-10677b5c-bcf1-4aac-be53-6f90481e0426 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084075 Jun 24 09:20:23.157355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1332/2956] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:23 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:23.996581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:23.997136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:24.003593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:24.004042 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:24.004798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:24.005232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:24.064183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:24.072666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4bca2e0d-03f7-48a4-a792-469cd4ef795f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079927 Jun 24 09:20:24.073228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1625/2957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:23 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:24.174854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:24.175482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:24.182485 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:24.182929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:24.183681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:24.184111 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:24.245558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:24.253849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:24.255270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:24.256536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e10b8535-bb44-43f5-8c32-4dd833e0f21b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085598 Jun 24 09:20:24.257081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1333/2958] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:24 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:25.094043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:25.094700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:25.101196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:25.101643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:25.102430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:25.102869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:25.162467 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:25.170500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ad0d68fd-4f27-4cc6-937f-a9a2a227f087 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.084989 Jun 24 09:20:25.171059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1626/2959] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:25 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:25.274782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:25.275949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:25.282452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:25.282910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:25.283677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:25.284113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:25.344012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:25.352484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:25.353996 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:25.355150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c93404c0-cf5f-48ce-a333-b3325d35fd0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084325 Jun 24 09:20:25.355716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1334/2960] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:25 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:26.188983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:26.189998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:26.197873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:26.198324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:26.199080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:26.199509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:26.259250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:26.267202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c49018a1-e23d-46ef-9770-08b4042a5c57 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082798 Jun 24 09:20:26.267757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1627/2961] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:26 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:26.372702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:26.373319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:26.379768 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:26.380221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:26.380988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:26.381423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:26.443507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:26.451777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:26.453272 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:26.454441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-274e5e1d-2e67-4867-8fb1-53df94afbc68 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085718 Jun 24 09:20:26.455004 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1335/2962] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:26 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:27.284874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:27.285478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:27.292208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:27.292649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:27.293395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:27.293856 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:27.352766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:27.361089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1a42a238-55c2-4784-9d78-c52f28356f24 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080060 Jun 24 09:20:27.361650 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1628/2963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:27 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:27.472414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:27.473021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:27.480028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:27.480470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:27.481226 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:27.481647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:27.542801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:27.550970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:27.552495 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:27.553602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e308e0bb-f1f1-4bad-8791-82d5067d5222 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085069 Jun 24 09:20:27.554177 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1336/2964] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:27 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:28.378046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:28.378644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:28.385710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:28.386155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:28.386903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:28.387497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:28.446027 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:28.454217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ffb85222-35d8-46f6-8232-28f076b613c7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080020 Jun 24 09:20:28.454771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1629/2965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:28 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:28.572765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:28.573372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:28.579831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:28.580277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:28.581035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:28.581466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:28.642792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:28.651086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:28.652566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:28.653712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-52be76a7-bcaa-4a30-b141-1550d783870e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085362 Jun 24 09:20:28.654298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1337/2966] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:28 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:29.470835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:29.471444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:29.477870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:29.478896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:29.479643 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:29.480069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:29.540299 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:29.548716 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0a06d9d5-ffa4-441a-819d-7a3132ac1327 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082029 Jun 24 09:20:29.549267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1630/2967] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:29 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:29.672413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:29.673017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:29.679504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:29.679958 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:29.680710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:29.681156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:29.740844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:29.749104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:29.750621 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:29.751752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c6200a03-e395-4bb4-96ec-cf7ef8780005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083239 Jun 24 09:20:29.752298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1338/2968] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:29 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:30.565495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:30.566119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:30.572580 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:30.573058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:30.573855 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:30.574294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:30.578180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:30.633406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:30.641944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8d449a1b-06a4-45ca-a967-8508cafb0a30 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080308 Jun 24 09:20:30.642506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1631/2969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:30 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:20:30.770305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:30.770920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:30.777472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:30.777965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:30.778739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:30.779182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:30.842133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:30.844258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:30.852427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:30.853953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:30.855121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-86f4e500-eef5-41b3-8248-02b62830e595 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088765 Jun 24 09:20:30.855671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1339/2970] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:30 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:31.259145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:20:31.259830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:20:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:20:31.659344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:31.659985 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:31.666919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:31.667366 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:31.668116 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:31.668547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:31.728249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:31.736166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-76f57de2-ef69-4255-b3a0-052456897aed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080699 Jun 24 09:20:31.736720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1632/2971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:31 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:31.873241 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:31.873812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:31.880562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:31.881015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:31.881807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:31.882248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:31.942136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:31.950460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:31.951951 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:31.953088 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6fb0d5a7-bcc1-47d0-9dea-14a7d331131e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084446 Jun 24 09:20:31.953648 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1340/2972] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:31 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:32.753508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:32.754139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:32.760901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:32.761348 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:32.762127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:32.762558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:32.821131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:32.828875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f70703f6-7d2c-4c23-bb79-3074d465bb5b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079207 Jun 24 09:20:32.829438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1633/2973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:32 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:32.971176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:32.971796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:32.974209 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=56 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:32.980178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:32.980635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:32.981414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:32.981892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:33.046219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:33.054572 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:33.056085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:33.057263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a635e32d-9ffe-4899-9b70-d28dd16bbff2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090010 Jun 24 09:20:33.057853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1341/2974] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:32 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:33.845646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:33.846275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:33.853590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:33.854069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:33.854826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:33.855261 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:33.920439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:33.928274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-910ab5e6-55a3-4394-8aab-2a661e302a03 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.086478 Jun 24 09:20:33.928838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1634/2975] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:33 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:34.075310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:34.075924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:34.082422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:34.082876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:34.083644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:34.084086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:34.225091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:34.233411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:34.234944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:34.236080 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-049be12d-4c3d-4545-a37e-1fde97d830c9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.164698 Jun 24 09:20:34.236637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1342/2976] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:34 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:34.945408 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:34.945971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:34.952387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:34.952840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:34.953594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:34.954052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:35.012966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:35.020784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f80beb33-d387-4758-8552-53caafc9eb89 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079312 Jun 24 09:20:35.021339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1635/2977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:34 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:35.253776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:35.254327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:35.260760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:35.261245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:35.262053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:35.262494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:35.331282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:35.340225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:35.341760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:35.342907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-437e7c64-b571-4ea2-b1b4-0ec7f9365df6 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.093237 Jun 24 09:20:35.343459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1343/2978] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:35 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:36.037618 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:36.038782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:36.046099 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:36.046541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:36.047296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:36.047720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:36.107208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:36.115035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e6e6727c-05d9-407b-be6b-a86de9533a2e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081314 Jun 24 09:20:36.115591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1636/2979] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:36 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:36.361202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:36.361861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:36.368444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:36.368898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:36.369698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:36.370129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:36.429873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:36.438626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:36.440130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:36.441281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3b0ebdb1-523b-45ce-b977-7565fc557018 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083942 Jun 24 09:20:36.441869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1344/2980] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:36 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:37.132330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:37.132915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:37.139956 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:37.140395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:37.141140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:37.141568 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:37.201903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:37.209836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0fa0f7f0-fbd3-4c26-8f8b-5611ea3db912 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081369 Jun 24 09:20:37.210398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1637/2981] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:37 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:37.459971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:37.460516 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:37.467581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:37.468029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:37.468785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:37.469223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:37.531381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:37.540042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:37.542184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:37.543324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-952c9871-0806-45d3-bf3d-eeeeb8ccdd6f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087406 Jun 24 09:20:37.543876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1345/2982] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:37 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:38.227674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:38.228731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:38.236498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:38.236943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:38.237718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:38.238154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:38.351137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:38.361024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8178adbc-9eee-47ab-8ee2-e17b818b20c6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.137171 Jun 24 09:20:38.361597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1638/2983] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:38 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:38.560809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:38.561424 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:38.568007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:38.568464 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:38.569237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:38.569694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:38.630026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:38.639147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:38.640629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:38.641795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-553242e7-bd3d-49fb-978a-588362a2f616 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084934 Jun 24 09:20:38.642347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1346/2984] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:38 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:39.377620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:39.378345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:39.384795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:39.385241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:39.386037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:39.386468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:39.445360 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:39.453154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-81df3d9e-ecf3-4a57-b2fa-46d5750711f8 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079399 Jun 24 09:20:39.453734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1639/2985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:39 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:39.663865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:39.664478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:39.671018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:39.671473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:39.672232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:39.672671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:39.735730 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:39.744136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:39.746157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:39.747292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cc607649-bfff-4215-8d90-62655fb227a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087872 Jun 24 09:20:39.747851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1347/2986] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:39 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:40.470559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:40.471162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:40.477587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:40.478501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:40.479874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:40.480306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:40.538885 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:40.547307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fe2e2aaf-12d6-48c0-bdfb-8dead19a59c2 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080625 Jun 24 09:20:40.547874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1640/2987] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:40 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:40.764945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:40.765565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:40.772076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:40.772532 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:40.773299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:40.773765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:40.833673 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:40.842185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:40.843663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:40.844801 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-116b6c72-d897-4679-bec5-d0114bf23abd tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084437 Jun 24 09:20:40.845353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1348/2988] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:40 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:41.564007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:41.564627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:41.571157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:41.571611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:41.572372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:41.573406 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:41.634080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:41.642038 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6bad0077-8ebb-4bc6-aad0-a6b5d92c41f7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081900 Jun 24 09:20:41.642608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1641/2989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:41 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:41.863497 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:41.864025 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:41.871255 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:41.871711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:41.872514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:41.872957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:41.937577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:41.945998 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:41.947496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:41.948639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0b6a731d-76c5-4d20-a27b-c4b6e497ce6d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089200 Jun 24 09:20:41.949201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1349/2990] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:41 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:42.659194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:42.659792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:42.662100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=56 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:42.667555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:42.668008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:42.668761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:42.669199 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:42.728544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:42.736500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a991076b-a271-4f65-9392-40523ef90899 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081218 Jun 24 09:20:42.737062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1642/2991] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:42 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:42.966536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:42.967151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:42.973557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:42.974042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:42.974805 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:42.975243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:43.034230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:43.043303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:43.044799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:43.045972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7ec15340-087c-4484-a4b6-ae1ad5a1a03d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083305 Jun 24 09:20:43.046520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1350/2992] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:42 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:43.752420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:43.753030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:43.759251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:43.759698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:43.760449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:43.760882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:43.778965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:20:43.779172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 (ip 10.222.0.48) !!! Jun 24 09:20:43.822446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:43.830824 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-036247d6-87a1-4907-9536-9980439ffcf6 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082452 Jun 24 09:20:43.831381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1643/2993] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:43 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:44.064588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:44.065197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:44.071723 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:44.072173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:44.072933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:44.073369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:44.135570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:44.143910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:44.145397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:44.146559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6c448ece-00d3-48a9-afc6-8fb6bbebdc54 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085931 Jun 24 09:20:44.147116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1351/2994] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:44 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:44.848404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:44.849018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:44.855550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:44.856010 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:44.856762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:44.857198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:44.918097 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:44.925982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-05ba261c-aab7-419d-b9e1-8ceaff30317e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081456 Jun 24 09:20:44.926560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1644/2995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:44 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:45.165375 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:45.166070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:45.172662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:45.173115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:45.173919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:45.174361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:45.235589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:45.244614 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:45.246725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:45.247861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5eb90b05-eeb8-402e-bf6d-b8f4066ae857 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086653 Jun 24 09:20:45.248412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1352/2996] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:45 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:45.943896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:45.944460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:45.952419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:45.952860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:45.953607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:45.954056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:46.013993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:46.021721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-14e28b13-9826-4ffb-9207-b2c797ba2424 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082125 Jun 24 09:20:46.022286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1645/2997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:45 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:46.266179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:46.266783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:46.273133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:46.273562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:46.274347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:46.274782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:46.337062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:46.345496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:46.347121 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:46.348237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e2543b7d-3891-4bd2-80e5-6227068f3332 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086033 Jun 24 09:20:46.348790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1353/2998] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:46 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:47.038448 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:47.039312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:47.046359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:47.046808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:47.047562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:47.047996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:47.108122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:47.115921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3eda776c-f74e-48c4-9ac4-30c516ad93a4 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081334 Jun 24 09:20:47.116490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1646/2999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:47 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:47.366864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:47.367408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:47.373901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:47.374355 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:47.375110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:47.375578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:47.435196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:47.443455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:47.444970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:47.446138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a15d1bd8-ddf0-45d4-b0fe-2a9628240fc4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083252 Jun 24 09:20:47.446703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1354/3000] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:47 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:48.133349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:48.133975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:48.141050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:48.141492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:48.142276 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:48.142702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:48.201236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:48.203405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:48.210807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9ad9870b-1cd7-445c-bc37-1488ca72aa66 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081306 Jun 24 09:20:48.211369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1647/3001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:48 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:48.464494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:48.465041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:48.471596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:48.472040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:48.472791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:48.473223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:48.534564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:48.543541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:48.545020 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:48.546171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9dcb6829-be96-450c-a2d2-50db21b615cb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085631 Jun 24 09:20:48.546728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1355/3002] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:48 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:49.227512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:49.228117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:49.235118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:49.235567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:49.236318 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:49.236753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:49.296069 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:49.304076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3e50342c-23ad-4cfe-9474-73779c86fa61 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080441 Jun 24 09:20:49.304635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1648/3003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:49 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:49.564158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:49.564774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:49.570886 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:49.571342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:49.572110 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:49.572551 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:49.590042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:49.635518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:49.644515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:49.646049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:49.647196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8852adbb-f8b2-4dd4-913c-e75bcfa43c25 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087139 Jun 24 09:20:49.647753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1356/3004] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:49 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:50.321485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:50.322152 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:50.328679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:50.329134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:50.329929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:50.330370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:50.390091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:50.399435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-379d797c-26f3-4cab-959f-87dced6750ac tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081785 Jun 24 09:20:50.400005 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1649/3005] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:50 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:50.665178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:50.665816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:50.672230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:50.672676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:50.673429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:50.673887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:50.736278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:50.744703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:50.746231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:50.747360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5b835da7-d2a0-49b7-ae18-fa431daee5f2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086306 Jun 24 09:20:50.747903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1357/3006] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:50 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:51.417173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:51.418361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:51.424714 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:51.425167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:51.425941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:51.426375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:51.485253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:51.492977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9c03385-b5d9-4130-91be-aa7578a6e102 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079872 Jun 24 09:20:51.493572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1650/3007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:51 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:51.764445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:51.765048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:51.771490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:51.771934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:51.772685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:51.773125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:51.832895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:51.841687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:51.843161 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:51.844409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-feedf4c2-7dd7-4218-9b7f-2f94147b42fc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.084033 Jun 24 09:20:51.844959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1358/3008] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:51 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:52.510402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:52.510987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:52.518024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:52.518464 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:52.519209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:52.519636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:52.578548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:52.586472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86a15f74-1157-4574-8c94-6aa49e7adcb7 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079885 Jun 24 09:20:52.587021 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1651/3009] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:52 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:52.862391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:52.863005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:52.869458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:52.869950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:52.871331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:52.871783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:52.935008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:52.943348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:52.944825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:52.945973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-332b4508-21bc-46c8-a799-7098f4127bed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.087493 Jun 24 09:20:52.946530 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1359/3010] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:52 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:53.603319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:53.603879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:53.610350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:53.610794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:53.611547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:53.611976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:53.671281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:53.679007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-de77d940-1813-4204-8113-96db2a3d930b tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079690 Jun 24 09:20:53.679560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1652/3011] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:53 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:53.964169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:53.965022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:53.971490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:53.971936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:53.972691 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:53.973122 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:54.034374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:54.042896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:54.044372 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:54.045500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8987b816-27ea-4d54-a3e3-728d63dea507 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085377 Jun 24 09:20:54.046077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1360/3012] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:53 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:54.695853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:54.696461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:54.703168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:54.703696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:54.704475 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:54.704903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:54.766362 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:54.774853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ef471d2e-245b-4615-b1ce-c0f4fa537bed tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082915 Jun 24 09:20:54.775599 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1653/3013] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:54 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:55.063959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:55.064566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:55.070965 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:55.071411 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:55.072164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:55.072594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:55.134440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:55.143214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:55.144692 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:55.145851 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fbd96b21-175b-4129-9da1-b8d0e2337302 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086069 Jun 24 09:20:55.146409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1361/3014] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:55 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:55.792387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:55.793500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:55.799989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:55.800430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:55.801175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:55.801600 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:55.860614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:55.868427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6fa4e9ad-28ef-4879-ba24-822d220deffe tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080080 Jun 24 09:20:55.868930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1654/3015] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:55 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:56.164834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:56.165400 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:56.172652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:56.173107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:56.173904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:56.174346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:56.239065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:56.247709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:56.249134 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:56.250317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-687870dd-4504-4673-a5ab-c171e11dd778 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.089782 Jun 24 09:20:56.250881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1362/3016] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:56 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:56.886791 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:56.887342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:56.894034 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:56.894494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:56.895243 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:56.895673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:56.956672 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:56.964941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-98b43316-de4e-4024-b0df-8ccb4481f549 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082352 Jun 24 09:20:56.965526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1655/3017] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:56 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:57.268270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:57.268890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:57.275383 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:57.275833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:57.276604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:57.277544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:57.338750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:57.347686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:57.349188 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:57.350356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3903a60a-4328-4895-be0b-e7e53e477861 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085960 Jun 24 09:20:57.350906 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1363/3018] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:57 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:57.981891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:57.982455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:57.988805 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:57.989247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:57.990017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:57.990447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:58.051528 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:58.059958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-441c3581-b19d-4762-b715-73de51b60a1f tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082026 Jun 24 09:20:58.060512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1656/3019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:57 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:58.368347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:58.368970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:58.376129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:58.376606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:58.377369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:58.377836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:58.440084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:58.448435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:58.450029 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:58.451173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-be5ca1ba-e501-4939-96be-f397cb167963 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086816 Jun 24 09:20:58.451728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1364/3020] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:58 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:20:59.077431 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:59.078053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:59.084582 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:59.085031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:59.085811 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:59.086249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:59.146706 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:59.155438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-671daf05-2c39-49ac-8a42-cd1c86b36e96 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.082311 Jun 24 09:20:59.156008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1657/3021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:20:59 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:20:59.469468 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:20:59.470037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:20:59.476524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:59.476978 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:59.477770 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:20:59.478212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:20:59.542059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:59.551182 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:59.552683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:20:59.553855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee3a6f7f-798c-408a-9fc7-8202d0e32cd8 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.088318 Jun 24 09:20:59.554404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1365/3022] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:20:59 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:00.173216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:00.173798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:00.180289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:00.180750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:00.181510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:00.181979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:00.240587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:00.249346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-efe7165e-c86b-4ab4-b38f-e58b0bb5586a tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.080042 Jun 24 09:21:00.250041 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1658/3023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:00 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:00.571615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:00.572213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:00.579073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:00.579535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:00.580303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:00.580742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:00.641833 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:00.650144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:00.651642 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:00.653451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ae33b115-feb2-4687-8387-236781037d78 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.085796 Jun 24 09:21:00.654038 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1366/3024] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:00 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:01.266052 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:01.266660 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:01.273124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:01.273572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:01.274345 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:01.274772 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:01.334078 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:01.342167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0c40016e-c116-48e8-9433-6a6988bc5999 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.079903 Jun 24 09:21:01.342739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1659/3025] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:01 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:01.672407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:01.673023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:01.679478 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:01.679930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:01.680687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:01.681128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:01.743489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:01.751921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:01.753426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:01.754582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-62dff1cf-b8da-4bc8-a56d-e06270c2764f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.086053 Jun 24 09:21:01.755136 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1367/3026] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:01 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:02.359479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:02.360089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:02.366586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:02.367638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:02.368443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:02.368882 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:02.428160 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:02.436029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0da511b3-a63a-4f23-97ca-3741c4916b15 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081120 Jun 24 09:21:02.436593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1660/3027] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:02 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:02.772420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:02.773032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:02.780208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:02.780665 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:02.781432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:02.781910 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:02.841274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:02.849612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:02.851150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:02.852329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d4ad5201-316d-4309-aab3-015a4cf2467e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.083822 Jun 24 09:21:02.852895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1368/3028] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:02 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:03.454145 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:03.454745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:03.461368 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:03.461845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:03.462593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:03.463020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:03.523435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:03.531323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d164f704-0bde-4584-ac64-ff7472d17137 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1388 microversion: 2.1 time: 0.081062 Jun 24 09:21:03.531879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1661/3029] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:03 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1388 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:03.870460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:03.871006 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:03.873382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=56 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:03.878667 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:03.879120 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:03.879885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:03.880323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:03.945546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:03.953931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:03.955420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:03.957068 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6eb66742-90a5-4fc5-8007-8a38186db452 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 200 len: 1444 microversion: 2.20 time: 0.090617 Jun 24 09:21:03.957627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1369/3030] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:03 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:04.188509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a46d332-a800-4360-8c91-9350f300363c"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:04.189738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:04.196373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.196826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.201853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.202423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.548334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:04.548942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:04.554983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.555434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.556196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.556633 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.588007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.588442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.588892 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lazy-loading 'fault' on Instance uuid dd3312c2-feed-4676-9667-bcfc1f8c0a34 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:21:04.629921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '323d30d600274919915b968252a1ee77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a09ac9cce354a3581d69b8edc154f7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:04.639039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-34e05c3f-f667-4804-9f5c-44930253e1b1 tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 200 len: 1482 microversion: 2.1 time: 0.094573 Jun 24 09:21:04.639604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1370/3031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:04 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 1482 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:04.888439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9fd1239c-16b1-4684-bf08-7fa6e150c1ab tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "POST /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703746 Jun 24 09:21:04.889031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1662/3032] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 09:21:04 2022] POST /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:04.977311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:04.977988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:04.986491 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.986950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:04.987724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:04.988160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.003844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e HTTP/1.1 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:05.005879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:21:05.007792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '6cb66bde-d133-41de-b6dd-295b0676be9e'} Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:05.008791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:21:05.010588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.012812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:05.013763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-90de386c-fa14-4028-8eb3-dbe4c284770f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 404 len: 111 microversion: 2.20 time: 0.041637 Jun 24 09:21:05.014266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1371/3033] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:04 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:21:05.024048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47b122e6-185f-4909-bcbc-078380ab97d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '.version_select at 0x7fa68c0d8e50>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:05.045545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47b122e6-185f-4909-bcbc-078380ab97d5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-184538959" status: 204 len: 0 microversion: 2.20 time: 0.026210 Jun 24 09:21:05.046374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1663/3034] 10.222.0.48 () {60 vars in 1258 bytes} [Fri Jun 24 09:21:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-184538959 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:21:05.276172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:05.277198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:05.283181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.283636 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.284404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.284843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.311022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:21:05.334941 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:05.388185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fbfa1153-854e-47a1-bcdd-67d2f04f4735 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 204 len: 0 microversion: 2.1 time: 0.115510 Jun 24 09:21:05.389097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1372/3035] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:05 2022] DELETE /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 09:21:05.397656 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:05.398492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:05.405925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.406380 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.407148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.407583 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.411655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:05.657919 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:05.658622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] [instance: dd3312c2-feed-4676-9667-bcfc1f8c0a34] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:05.665893 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.666342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.667115 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:05.667605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:05.681938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] HTTP exception thrown: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Request method failure captured: Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 HTTP/1.1 Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXnNDmKMsl9zbfCV_WV2zm5vd3E0cswIigV5E_ksrsajgiF9Bwfdc367owZnYNrmr1uzCiiAjJGtMdPozol8kT1U-RPaLaE8CNNu7shivWT6RsVtYK2qzzDxwcgYV2bFlQJ87xsglAKLPqv8vuHOVTh9IqJQQpDMfd6s2wVjQEqQZLc Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:05.683603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4a09ac9cce354a3581d69b8edc154f7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 4a09ac9cce354a3581d69b8edc154f7c Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-TestMinimumBasicScenario-309140240 Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 323d30d600274919915b968252a1ee77 Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-TestMinimumBasicScenario-309140240-project Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. Jun 24 09:21:05.685413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'dd3312c2-feed-4676-9667-bcfc1f8c0a34'} Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:05.686600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. Jun 24 09:21:05.688040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:05.689852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Returning 404 to user: Instance dd3312c2-feed-4676-9667-bcfc1f8c0a34 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:05.689852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9c10855c-6945-43b5-8360-3769db413f3e tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34" status: 404 len: 111 microversion: 2.1 time: 0.031667 Jun 24 09:21:05.689852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1373/3036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:05 2022] GET /compute/v2.1/servers/dd3312c2-feed-4676-9667-bcfc1f8c0a34 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:21:05.694408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-97808eb5-8d59-4b0e-a1d7-92950dc844ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] Calling method '.version_select at 0x7fa68c0e3c10>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:05.719662 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-97808eb5-8d59-4b0e-a1d7-92950dc844ab tempest-TestMinimumBasicScenario-309140240 tempest-TestMinimumBasicScenario-309140240-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-154716723" status: 202 len: 0 microversion: 2.1 time: 0.029689 Jun 24 09:21:05.720547 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1374/3037] 10.222.0.48 () {58 vars in 1268 bytes} [Fri Jun 24 09:21:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-154716723 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:21:05.847866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:05.855967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b23ccf5-63fb-435a-91a7-c0eed26bbdad tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1507 microversion: 2.1 time: 0.462790 Jun 24 09:21:05.857398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1664/3038] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:05 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1507 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:06.206043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-112cfb87-fc04-40f4-8242-2bd0bc6f208d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: .version_select at 0x7fa6900d2790>, body: {"keypair": {"name": "tempest-keypair-1200151294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlYoLgciMP6OfJnhZOQj0s2OwY0WYj8MSoBgvmUw5+mHZv8wCyMfxQacnQGsMHzFACagVCqt0ip0sk1qBaM9AAhFkBJuAvt4ZJHy8Ebc98wIM1tMZrDPt2UOaIPuM0uFQ=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:06.222611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-112cfb87-fc04-40f4-8242-2bd0bc6f208d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for project 1228688aff08407bb65f0876f4de6249. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:21:06.226819 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-112cfb87-fc04-40f4-8242-2bd0bc6f208d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for user 0a3be1ca51b0472eb1a23f9d052a3c75 and project 1228688aff08407bb65f0876f4de6249. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:21:06.257651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-112cfb87-fc04-40f4-8242-2bd0bc6f208d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055769 Jun 24 09:21:06.258294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1375/3039] 10.222.0.48 () {62 vars in 1199 bytes} [Fri Jun 24 09:21:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 24 09:21:06.874792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:06.876142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:06.884591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:06.885395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:06.887059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:06.901696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:06.979604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-d739def3-092a-4bff-acee-a503e791c6ae req-1aef88e4-83c2-4dc2-9da9-fa4b54aa3a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fc2b80-e02c-4179-b740-707cd0b41089", "name": "network-vif-deleted", "tag": "b75490f8-63fa-4519-9fcb-164db7181bf0"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:06.988748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d739def3-092a-4bff-acee-a503e791c6ae req-1aef88e4-83c2-4dc2-9da9-fa4b54aa3a43 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:06.989337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d739def3-092a-4bff-acee-a503e791c6ae req-1aef88e4-83c2-4dc2-9da9-fa4b54aa3a43 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:07.002849 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-d739def3-092a-4bff-acee-a503e791c6ae req-1aef88e4-83c2-4dc2-9da9-fa4b54aa3a43 service nova] Creating event network-vif-deleted:b75490f8-63fa-4519-9fcb-164db7181bf0 for instance 19fc2b80-e02c-4179-b740-707cd0b41089 on hv-cinder-78729 Jun 24 09:21:07.010364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-d739def3-092a-4bff-acee-a503e791c6ae req-1aef88e4-83c2-4dc2-9da9-fa4b54aa3a43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121327 Jun 24 09:21:07.011811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1376/3040] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:07.070843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:07.079724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7491bdc5-037b-4aa1-b020-c089c4829871 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 200 len: 1465 microversion: 2.1 time: 0.209710 Jun 24 09:21:07.080443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1665/3041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:06 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 1465 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:08.098889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:08.100277 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 19fc2b80-e02c-4179-b740-707cd0b41089] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:08.108883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.109737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.110759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.111838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.128366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 HTTP/1.1 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:08.130541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. Jun 24 09:21:08.132196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '19fc2b80-e02c-4179-b740-707cd0b41089'} Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:08.133474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. Jun 24 09:21:08.135462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:08.137628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 404 to user: Instance 19fc2b80-e02c-4179-b740-707cd0b41089 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:08.137628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-59aadaad-4166-41ad-89d2-67a531515b17 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089" status: 404 len: 111 microversion: 2.1 time: 0.039302 Jun 24 09:21:08.137628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1377/3042] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:08 2022] GET /compute/v2.1/servers/19fc2b80-e02c-4179-b740-707cd0b41089 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:08.141614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:08.142241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:08.148793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.149247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.150053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.150707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.176746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:21:08.256389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5cbe1f26-eb39-4d82-a35e-8e214ef20a18 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 204 len: 0 microversion: 2.1 time: 0.118263 Jun 24 09:21:08.257376 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1666/3043] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:08 2022] DELETE /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:21:08.266168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:08.266783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:08.278948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.278948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.278948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:08.278948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:08.344183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-756664058", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "59b4a86f-643d-49ec-adbf-4386438b074f"}], "security_groups": [{"name": "tempest-securitygroup--1753461204"}], "key_name": "tempest-keypair-1200151294", "user_data": "}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:08.572459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:08.574516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] validate_networks() for [('59b4a86f-643d-49ec-adbf-4386438b074f', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:21:08.581098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0065179b-f632-4e28-a599-0edab8d14858 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.318941 Jun 24 09:21:08.582143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1378/3044] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:08 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:09.221635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:21:09.222183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:21:09.222548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:21:09.222952 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:21:09.223365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:21:09.232494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:09.233223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:09.234278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:09.234970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:09.255101 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for project 1228688aff08407bb65f0876f4de6249. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:21:09.259202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Getting quotas for user 0a3be1ca51b0472eb1a23f9d052a3c75 and project 1228688aff08407bb65f0876f4de6249. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:21:09.271842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:21:09.274446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:21:09.334388 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-42d62747-e90c-437f-9e2d-81be7a84c133 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.996621 Jun 24 09:21:09.335834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1667/3045] 10.222.0.48 () {62 vars in 1187 bytes} [Fri Jun 24 09:21:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 09:21:09.347030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:09.348606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:09.440989 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:09.450263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:09.452180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:09.453389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-87460345-a4a5-4046-b2fe-bbadb76fb127 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1281 microversion: 2.20 time: 0.111607 Jun 24 09:21:09.454229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1379/3046] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:09 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:09.603416 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:09.604168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:09.620522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:09.621293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:09.622322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:09.622843 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:09.807266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:09.818043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b1fdc2c7-0a0c-4042-b21d-70cad94fbd4b tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1521 microversion: 2.1 time: 0.218462 Jun 24 09:21:09.819304 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1668/3047] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:09 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:10.475003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:10.475988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:10.494573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.495631 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.496313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.496758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.571553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:10.579762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:10.581304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:10.582442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-16310ffb-4ab4-4882-b76d-4bf6a888db71 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1341 microversion: 2.20 time: 0.113254 Jun 24 09:21:10.583207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1380/3048] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:10 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1341 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:10.626950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-c9f60a5e-d5dd-4695-a9d5-ef92eea8f916 req-841ea328-b903-4c88-9cb6-9ac54604e05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8717b2ef-e244-4d90-a381-3afddfc2833e", "name": "network-vif-deleted", "tag": "3c6e2dd8-a912-4487-9065-1cf694fd04c2"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:10.638532 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c9f60a5e-d5dd-4695-a9d5-ef92eea8f916 req-841ea328-b903-4c88-9cb6-9ac54604e05c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.639324 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c9f60a5e-d5dd-4695-a9d5-ef92eea8f916 req-841ea328-b903-4c88-9cb6-9ac54604e05c service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.660165 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-c9f60a5e-d5dd-4695-a9d5-ef92eea8f916 req-841ea328-b903-4c88-9cb6-9ac54604e05c service nova] Creating event network-vif-deleted:3c6e2dd8-a912-4487-9065-1cf694fd04c2 for instance 8717b2ef-e244-4d90-a381-3afddfc2833e on hv-cinder-78729 Jun 24 09:21:10.669614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-c9f60a5e-d5dd-4695-a9d5-ef92eea8f916 req-841ea328-b903-4c88-9cb6-9ac54604e05c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046360 Jun 24 09:21:10.670461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1669/3049] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:10.835826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:10.837515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:10.848687 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.849529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.850847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.851467 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.890231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:10.890559 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:10.891003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lazy-loading 'fault' on Instance uuid 8717b2ef-e244-4d90-a381-3afddfc2833e {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:21:11.194026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:11.202339 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-74f4084e-dff6-4e14-bf1e-ce4b2a1a3a97 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1312 microversion: 2.1 time: 0.370323 Jun 24 09:21:11.202908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1381/3050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:10 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1312 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:11.601708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:11.602412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:11.614943 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:11.615393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:11.616174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:11.616613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:11.703511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:11.706044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:11.707637 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:11.709948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c43ff2f7-4b74-4ca0-a669-d91e2bd73136 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1339 microversion: 2.20 time: 0.112229 Jun 24 09:21:11.711721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1670/3051] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:11 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:21:12.226812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:12.227588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:12.237705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:12.239374 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:12.240762 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:12.242109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:12.281929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:12.282379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:12.282914 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lazy-loading 'fault' on Instance uuid 8717b2ef-e244-4d90-a381-3afddfc2833e {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:21:12.353789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7152500089314edea337b9a58830f12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9620da2622aa454ea30ccf09edf6b1f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:12.366505 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e700d3c4-de03-40f4-ac5a-2d12562b9d16 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 200 len: 1312 microversion: 2.1 time: 0.149048 Jun 24 09:21:12.367238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1382/3052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:12 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:12.731340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:12.733009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:12.737861 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:12.745213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:12.746030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:12.747192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:12.748483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.027563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:13.039135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:13.051384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:13.052883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-931b953d-901e-4a91-8335-96f45c54b076 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.328412 Jun 24 09:21:13.053987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1671/3053] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:12 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:13.384083 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:13.384704 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] [instance: 8717b2ef-e244-4d90-a381-3afddfc2833e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:13.396344 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:13.396802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.397582 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:13.398058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.416655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] HTTP exception thrown: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Request method failure captured: Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e HTTP/1.1 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlPtFXMgqnw6xyJ11tLTi9hKG7oKynY6mJnHPr1pv4W56Y3SwFluZjI9cUDMho2sYBfAqWVoPH-nM1yLgVfK9mHFWzL78CqKsbwyJwPNmh2KDHNLonMCQMEa0WBejqeFH-RRd32A50G6auo8Qrr1kLiC1WS510pFRtJW31O-qcRJyg Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:13.418853 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9620da2622aa454ea30ccf09edf6b1f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 9620da2622aa454ea30ccf09edf6b1f8 Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2012808495 Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 7152500089314edea337b9a58830f12d Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2012808495-project Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. Jun 24 09:21:13.420689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '8717b2ef-e244-4d90-a381-3afddfc2833e'} Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:13.421716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. Jun 24 09:21:13.423368 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:13.426116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] Returning 404 to user: Instance 8717b2ef-e244-4d90-a381-3afddfc2833e could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:13.427743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e486ca0a-776a-459f-bc89-fe159b3da901 tempest-ServerRescueNegativeTestJSON-2012808495 tempest-ServerRescueNegativeTestJSON-2012808495-project] 10.222.0.48 "GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e" status: 404 len: 111 microversion: 2.1 time: 0.047928 Jun 24 09:21:13.428993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1383/3054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:13 2022] GET /compute/v2.1/servers/8717b2ef-e244-4d90-a381-3afddfc2833e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:13.579126 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-9755a4c4-4c1d-45bc-8316-98480df89843 req-0ab85619-0375-4665-ae1e-cfef9af1a0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:13.597180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9755a4c4-4c1d-45bc-8316-98480df89843 req-0ab85619-0375-4665-ae1e-cfef9af1a0a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:13.599289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9755a4c4-4c1d-45bc-8316-98480df89843 req-0ab85619-0375-4665-ae1e-cfef9af1a0a2 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.653847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-9755a4c4-4c1d-45bc-8316-98480df89843 req-0ab85619-0375-4665-ae1e-cfef9af1a0a2 service nova] Creating event network-changed:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:21:13.664543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-9755a4c4-4c1d-45bc-8316-98480df89843 req-0ab85619-0375-4665-ae1e-cfef9af1a0a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090300 Jun 24 09:21:13.665151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1672/3055] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:13.798303 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:13.798806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:13.807865 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:13.808366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.809109 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:13.809549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:13.971688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lazy-loading 'services' on Instance uuid 4233f657-d7b2-4e34-b645-98352754eb77 {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:21:14.075883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:14.081444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:14.084233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6b20fc94-653c-4b4a-bdee-e05994fd1029 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments/7a46d332-a800-4360-8c91-9350f300363c" status: 202 len: 0 microversion: 2.1 time: 0.289331 Jun 24 09:21:14.090273 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1384/3056] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:21:13 2022] DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments/7a46d332-a800-4360-8c91-9350f300363c => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:21:14.097046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:14.100729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:14.101473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:14.102939 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:14.105106 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:14.107087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:14.134990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:14.135465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:14.137742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:14.139587 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:14.200842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f231b0b1-853c-451a-9af0-68aec423d187 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108121 Jun 24 09:21:14.202129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1385/3057] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:21:14 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:14.399043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:14.407190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:14.408764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:14.409927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-695a512e-1991-4a90-a8be-4a6fc9f57f53 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.343197 Jun 24 09:21:14.410624 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1673/3058] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:14 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:21:15.213063 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:15.214180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:15.221966 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.222596 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.223850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.224562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.276543 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-47a18cef-828c-41ba-9ea7-71ad187f7b48 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067741 Jun 24 09:21:15.282442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1386/3059] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:21:15 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:21:15.399763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:15.400361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:15.413646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.418396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.419589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.421029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.430462 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:15.431337 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:15.442976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.443863 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.445285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.445794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.501182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:21:15.662369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-09ce5704-c87c-4027-bbd0-40427e3e69ed tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 204 len: 0 microversion: 2.1 time: 0.276626 Jun 24 09:21:15.663394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1674/3060] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:15 2022] DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:21:15.673089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:15.673887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:15.680569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.681263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:15.682167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:15.682665 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:16.040644 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:16.049907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:16.051619 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:16.052909 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b665ecb0-b736-4ada-a3a9-ff12cdfc8a80 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.628457 Jun 24 09:21:16.053463 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1387/3061] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:15 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:21:16.074333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:16.082989 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5bda0744-4541-429a-8739-80e33bbb9924 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1682 microversion: 2.1 time: 0.414165 Jun 24 09:21:16.083677 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1675/3062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:15 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1682 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:17.071043 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:17.071514 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:17.080602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:17.081419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:17.082334 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:17.082880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:17.102868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:17.104293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:17.114709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:17.115419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:17.116452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:17.117724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:17.365980 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:17.369030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:17.377222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:17.378735 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-71e2c63d-0c04-4541-a6c0-87e19a254d18 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1682 microversion: 2.1 time: 0.281938 Jun 24 09:21:17.379329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1676/3063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:17 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1682 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:17.390534 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:17.391761 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-71707475-28a8-42a6-a9ef-af94e72aab98 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.325103 Jun 24 09:21:17.392313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1388/3064] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:17 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:18.396520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:18.397121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:18.405159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:18.405612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:18.406398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:18.406826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:18.409041 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:18.409652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:18.416152 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:18.416607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:18.418130 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:18.418758 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:18.617290 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:18.618342 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:18.629252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:18.630796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:18.632156 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b926d4b9-88fa-491a-9f6f-5190f3f19d0f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.226950 Jun 24 09:21:18.633388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1389/3065] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:18 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:21:18.646693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2d2d5103-e918-4603-afd1-fdc85e0cc8e4 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1682 microversion: 2.1 time: 0.254094 Jun 24 09:21:18.647282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1677/3066] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:18 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1682 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:19.649718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:19.651010 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:19.653413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=6 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:19.664911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:19.666261 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:19.667122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:19.668380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:19.668512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:19.669163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:19.672131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:19.674723 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:19.689048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:19.689910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:19.692131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:19.693040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:19.815581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcaf1fc4ba1b4453a24260be3b908f0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bbf131dc8e64b818285edcfbcdb0b51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:19.823879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-87843bef-802a-4568-8b85-9d479d5912e2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 200 len: 1615 microversion: 2.1 time: 0.163170 Jun 24 09:21:19.825287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1678/3067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:19 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 1615 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:19.923571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-41829edf-3ffb-485c-a126-4c28ee1883b8 req-6902d963-0c6a-4815-91c1-31a65094ea29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4233f657-d7b2-4e34-b645-98352754eb77", "name": "network-vif-deleted", "tag": "58467307-daf6-435b-a031-bfc5560c7c97"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:19.940458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-41829edf-3ffb-485c-a126-4c28ee1883b8 req-6902d963-0c6a-4815-91c1-31a65094ea29 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:19.940901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-41829edf-3ffb-485c-a126-4c28ee1883b8 req-6902d963-0c6a-4815-91c1-31a65094ea29 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:19.958877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-41829edf-3ffb-485c-a126-4c28ee1883b8 req-6902d963-0c6a-4815-91c1-31a65094ea29 service nova] Creating event network-vif-deleted:58467307-daf6-435b-a031-bfc5560c7c97 for instance 4233f657-d7b2-4e34-b645-98352754eb77 on hv-cinder-78729 Jun 24 09:21:19.965091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-41829edf-3ffb-485c-a126-4c28ee1883b8 req-6902d963-0c6a-4815-91c1-31a65094ea29 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045149 Jun 24 09:21:19.967725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1679/3068] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:19.989654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:20.025239 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:20.027513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:20.033163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d20bc7a2-e36e-4bc7-ad07-072d9457b92d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.383816 Jun 24 09:21:20.034601 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1390/3069] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:19 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:20.843274 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:20.844664 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:20.852594 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:20.853373 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:20.854457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:20.855111 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:20.858867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:20.878369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 HTTP/1.1 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:20.880259 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:20.882188 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '4233f657-d7b2-4e34-b645-98352754eb77'} Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:20.883853 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:20.886296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:20.890011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:20.891119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-30432545-d324-4231-862b-7237b237e6eb tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 404 len: 111 microversion: 2.1 time: 0.053329 Jun 24 09:21:20.892235 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1680/3070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:20 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:20.900535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-80921d61-06be-4e15-83cb-942c30b76082 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '.version_select at 0x7fa68c2f2430>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:20.922032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-80921d61-06be-4e15-83cb-942c30b76082 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-114522886" status: 202 len: 0 microversion: 2.1 time: 0.025404 Jun 24 09:21:20.922933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1391/3071] 10.222.0.48 () {58 vars in 1217 bytes} [Fri Jun 24 09:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-114522886 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:21:21.052806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:21.053699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:21.061253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:21.061734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:21.062511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:21.062948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:21.333210 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:21.350238 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:21.355911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:21.360655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b46023ff-bd28-4a14-806e-84489bba6355 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.310275 Jun 24 09:21:21.362793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1681/3072] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:21 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:22.380959 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:22.381576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:22.394809 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:22.395327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:22.396151 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:22.396592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:22.614444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-c2399c9f-70a5-4be5-a0c1-38ad5189c82d req-d0b35572-594f-4020-a6a1-0299bd4569aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "name": "network-vif-plugged", "status": "completed", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:22.625480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c2399c9f-70a5-4be5-a0c1-38ad5189c82d req-d0b35572-594f-4020-a6a1-0299bd4569aa service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:22.626536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-c2399c9f-70a5-4be5-a0c1-38ad5189c82d req-d0b35572-594f-4020-a6a1-0299bd4569aa service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:22.658672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:22.660284 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-c2399c9f-70a5-4be5-a0c1-38ad5189c82d req-d0b35572-594f-4020-a6a1-0299bd4569aa service nova] Creating event network-vif-plugged:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:21:22.668901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:22.670908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-c2399c9f-70a5-4be5-a0c1-38ad5189c82d req-d0b35572-594f-4020-a6a1-0299bd4569aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.264255 Jun 24 09:21:22.671106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:22.672760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-78a9ded9-273a-4436-a4c2-354a0ce53836 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.296269 Jun 24 09:21:22.673220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1682/3073] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:22.673807 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1392/3074] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:22 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:22.985091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:22.985785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:22.996640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:22.998699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:22.999928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:23.000509 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:23.023907 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 HTTP/1.1 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:23.027402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.029209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '4233f657-d7b2-4e34-b645-98352754eb77'} Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:23.030343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.032516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.034193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:23.034193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1c10778a-2171-409d-81cb-93a8305a2b1f tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 404 len: 111 microversion: 2.1 time: 0.051474 Jun 24 09:21:23.044974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:23.046159 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 4233f657-d7b2-4e34-b645-98352754eb77] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:23.053914 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1683/3075] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:22 2022] DELETE /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:23.056612 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:23.057313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:23.059922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:23.060753 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:23.080690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 HTTP/1.1 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:23.082907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.084690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '4233f657-d7b2-4e34-b645-98352754eb77'} Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:23.085724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. Jun 24 09:21:23.087439 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:23.088902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 4233f657-d7b2-4e34-b645-98352754eb77 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:23.088902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ba0bf1f3-58c0-46cd-a8f7-11690ee7eff2 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77" status: 404 len: 111 microversion: 2.1 time: 0.049051 Jun 24 09:21:23.088902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1393/3076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:23 2022] GET /compute/v2.1/servers/4233f657-d7b2-4e34-b645-98352754eb77 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:23.693446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:23.694563 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:23.702546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:23.702992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:23.703755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:23.704190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:23.844942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:23.853995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:23.855917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:23.857043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d2c01a30-d88e-410d-8889-69267884d89f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1407 microversion: 2.20 time: 0.169161 Jun 24 09:21:23.857738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1684/3077] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:23 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:24.296944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-66190a59-4e0c-4385-be90-348b7373f657 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: .version_select at 0x7fa68c049550>, body: {"keypair": {"name": "tempest-keypair-1607042678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEImo7uy9WBn+5nt7/8/UkPnB7yfaOZSFBghkPfhfExpbvQ7bzGrnzvxKVYMBG+ZOq22CEAHtlGmRLkiQDI596GzWDGJsGSDngmGRzVFINuN6Uohp3LN+HMItg26PMVHww=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:24.299895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:24.300393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:24.306609 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.307330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.308808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.309423 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.312081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-66190a59-4e0c-4385-be90-348b7373f657 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for project c4e783e533d143e987b51dfdafc690ee. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:21:24.316322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-66190a59-4e0c-4385-be90-348b7373f657 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for user 3b07944a2c124f2da28acaf4df2e215d and project c4e783e533d143e987b51dfdafc690ee. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:21:24.324529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f HTTP/1.1 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:24.326140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.327862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '8da110a3-8877-41cf-b6a1-bc17120e309f'} Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:24.328921 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.330610 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.333091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:24.334045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1386142a-99b7-4d71-b596-36b2715cc4a1 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 404 len: 111 microversion: 2.1 time: 0.038582 Jun 24 09:21:24.337749 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1685/3078] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:24 2022] DELETE /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:24.343384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:24.344087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: 8da110a3-8877-41cf-b6a1-bc17120e309f] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:24.345993 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-66190a59-4e0c-4385-be90-348b7373f657 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110197 Jun 24 09:21:24.347456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1394/3079] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 09:21:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:24.356292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.356746 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.357517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.357976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.373874 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f HTTP/1.1 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:24.375432 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.377192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '8da110a3-8877-41cf-b6a1-bc17120e309f'} Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:24.381813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. Jun 24 09:21:24.384881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:24.386757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance 8da110a3-8877-41cf-b6a1-bc17120e309f could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:24.386757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bc9716ba-7cd9-4dc5-8d20-3a74c6de1f9e tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f" status: 404 len: 111 microversion: 2.1 time: 0.037596 Jun 24 09:21:24.386757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1686/3080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:24 2022] GET /compute/v2.1/servers/8da110a3-8877-41cf-b6a1-bc17120e309f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:21:24.875228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:24.876018 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:24.882926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.883381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.884168 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:24.884606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:24.901681 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:25.116162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:25.124741 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:25.126707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:25.128067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8be96730-861d-4aee-b474-14822c7b4814 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1600 microversion: 2.20 time: 0.256787 Jun 24 09:21:25.128625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1395/3081] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:21:24 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1600 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:21:25.146696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:25.147321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:25.154383 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.154836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.155602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.156237 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.252636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a666a4f3-e139-4a12-aa7e-bcede6dfb7cc tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109828 Jun 24 09:21:25.259953 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1687/3082] 10.222.0.48 () {60 vars in 1315 bytes} [Fri Jun 24 09:21:25 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:21:25.540219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:25.540839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:25.548426 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.549138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.550230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.550900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.566451 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 HTTP/1.1 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:25.568562 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.570116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'e738abd4-3c88-4daf-a1a5-0ff726682731'} Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:25.570979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.572362 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.576396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:25.577476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fb61e323-cd6c-424a-a591-8c35088a16d7 tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 404 len: 111 microversion: 2.1 time: 0.041541 Jun 24 09:21:25.586226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:25.587135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] [instance: e738abd4-3c88-4daf-a1a5-0ff726682731] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:25.592777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1396/3083] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:21:25 2022] DELETE /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:25.594987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.595756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.596755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:25.597458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:25.623319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] HTTP exception thrown: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Request method failure captured: Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 HTTP/1.1 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXm2q13k1bH6Sra_Y52RR1rrdC3s9DMcsxz4P_aBV3K8ibEmLfb31ZiEt5H5osVE5lyoviUVTzSM46Cdvu381TJsoIIz3HyJr9bP-ACOGeff9X4AT7-cCT5EBAWdcXUq00_5-jvKNORtvYxNyALPnzlr4gmU-nqjkrx11Ef_W112PqI Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:25.627501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8bbf131dc8e64b818285edcfbcdb0b51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 8bbf131dc8e64b818285edcfbcdb0b51 Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1757468114 Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: fcaf1fc4ba1b4453a24260be3b908f0f Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeNegativeTest-1757468114-project Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.629074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': 'e738abd4-3c88-4daf-a1a5-0ff726682731'} Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:25.629948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. Jun 24 09:21:25.631332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:25.634942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] Returning 404 to user: Instance e738abd4-3c88-4daf-a1a5-0ff726682731 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:25.636587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-51c9d36b-3ccc-4693-8f74-2029fe2eb5be tempest-AttachVolumeNegativeTest-1757468114 tempest-AttachVolumeNegativeTest-1757468114-project] 10.222.0.48 "GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731" status: 404 len: 111 microversion: 2.1 time: 0.054192 Jun 24 09:21:25.640892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1688/3084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:25 2022] GET /compute/v2.1/servers/e738abd4-3c88-4daf-a1a5-0ff726682731 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:21:25.852821 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-267604534", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de77ebef-2b18-49b6-9d11-8b50b3a75944"}], "security_groups": [{"name": "tempest-securitygroup--2058952591"}], "key_name": "tempest-keypair-1607042678", "user_data": "}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:26.223750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] validate_networks() for [('de77ebef-2b18-49b6-9d11-8b50b3a75944', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:21:26.770843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:21:26.771427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:21:26.771537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:21:26.771859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:21:26.772271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:21:26.783129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:26.783825 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:26.784922 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:26.785522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:26.798297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:26.807541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for project c4e783e533d143e987b51dfdafc690ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:21:26.812433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for user 3b07944a2c124f2da28acaf4df2e215d and project c4e783e533d143e987b51dfdafc690ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:21:26.828213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:21:26.831275 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:21:26.907609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-46f68260-a420-438e-9637-fa2d01cb68e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.057588 Jun 24 09:21:26.915515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1397/3085] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:21:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:21:26.920742 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-477c232f-b6ed-440f-8a24-f8fd9c945dc6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:26.921617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-477c232f-b6ed-440f-8a24-f8fd9c945dc6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:27.009439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-477c232f-b6ed-440f-8a24-f8fd9c945dc6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:27.016983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-477c232f-b6ed-440f-8a24-f8fd9c945dc6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1237 microversion: 2.1 time: 0.100816 Jun 24 09:21:27.017545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1689/3086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:26 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:27.047094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-d22cce7a-95e6-4056-989d-67dedb245d13 req-81e50e3a-e46a-4044-aa55-c10d6f1f21e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:27.061713 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d22cce7a-95e6-4056-989d-67dedb245d13 req-81e50e3a-e46a-4044-aa55-c10d6f1f21e6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:27.063938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d22cce7a-95e6-4056-989d-67dedb245d13 req-81e50e3a-e46a-4044-aa55-c10d6f1f21e6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:27.091249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-d22cce7a-95e6-4056-989d-67dedb245d13 req-81e50e3a-e46a-4044-aa55-c10d6f1f21e6 service nova] Creating event network-changed:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:21:27.100256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-d22cce7a-95e6-4056-989d-67dedb245d13 req-81e50e3a-e46a-4044-aa55-c10d6f1f21e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056781 Jun 24 09:21:27.100881 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1398/3087] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:28.037912 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:28.038547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:28.052422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:28.053205 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:28.054972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:28.056023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:28.142876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:28.152848 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0c35b996-4058-4a1f-a2f1-57916c68df7f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1289 microversion: 2.1 time: 0.122949 Jun 24 09:21:28.153438 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1690/3088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:28 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:29.171799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:29.172564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:29.178858 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:29.179311 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:29.180079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:29.180517 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:29.249842 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:29.257611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d669d8e6-4232-4b56-8985-86f0d6e52f03 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1295 microversion: 2.1 time: 0.091062 Jun 24 09:21:29.258348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1399/3089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:29 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1295 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:30.275219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:30.275841 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:30.283421 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:30.283881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:30.284700 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:30.285142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:30.414531 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:30.425842 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-be382187-c57d-44b3-95c3-6428ccddd0df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.154397 Jun 24 09:21:30.427185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1691/3090] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:30 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:30.982133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-de9f5f1b-274f-43dd-ae02-fe98d5eda7b7 req-eb5dbb79-7005-406e-a356-f7e6cf1eb6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e110c88-8145-4331-a023-db93d115ea78", "tag": "ab177315-e080-44e4-a9b0-2c51e445a027"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:31.009787 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-de9f5f1b-274f-43dd-ae02-fe98d5eda7b7 req-eb5dbb79-7005-406e-a356-f7e6cf1eb6e6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:31.010237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-de9f5f1b-274f-43dd-ae02-fe98d5eda7b7 req-eb5dbb79-7005-406e-a356-f7e6cf1eb6e6 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:31.027490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-de9f5f1b-274f-43dd-ae02-fe98d5eda7b7 req-eb5dbb79-7005-406e-a356-f7e6cf1eb6e6 service nova] Creating event network-changed:ab177315-e080-44e4-a9b0-2c51e445a027 for instance 0e110c88-8145-4331-a023-db93d115ea78 on hv-cinder-78729 Jun 24 09:21:31.039249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-de9f5f1b-274f-43dd-ae02-fe98d5eda7b7 req-eb5dbb79-7005-406e-a356-f7e6cf1eb6e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065526 Jun 24 09:21:31.040262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1400/3091] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:31.445612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:31.446415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:31.458804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:31.462043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:31.464555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:31.465182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:31.644084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:31.651415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bb16711b-3bf3-42b4-a6df-0a29b872755a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.212380 Jun 24 09:21:31.651978 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1692/3092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:31 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:32.640694 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c3b12582-6fe9-4a4c-b7bd-a367ad1baade tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Action: 'create', calling method: .version_select at 0x7fa68c043670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-712707853"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:32.669818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:32.670552 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:32.678492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:32.678965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:32.679832 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:32.680342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:32.838436 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:32.847056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4d43bf0e-4794-428b-98c1-96acec9d290a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.182354 Jun 24 09:21:32.847866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1693/3093] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:32 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:32.942549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c3b12582-6fe9-4a4c-b7bd-a367ad1baade tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.413410 Jun 24 09:21:32.943319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1401/3094] 10.222.0.48 () {60 vars in 1154 bytes} [Fri Jun 24 09:21:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 415 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 09:21:32.954902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1926132c-1441-443a-a86f-ace1b63422b3 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa69015e430>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:33.002741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1926132c-1441-443a-a86f-ace1b63422b3 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 200 len: 344 microversion: 2.1 time: 0.051626 Jun 24 09:21:33.003312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1694/3095] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 09:21:32 2022] GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:33.864590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:33.865246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:33.872005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:33.872447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:33.873198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:33.873630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:34.002446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:34.009964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e315f265-17c6-4410-8b32-8180d2ade68b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.149740 Jun 24 09:21:34.010818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1402/3096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:33 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:34.015798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1821a8fb-b164-4635-b43e-ad6ff7c039fc tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690139820>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:34.067221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1821a8fb-b164-4635-b43e-ad6ff7c039fc tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 200 len: 345 microversion: 2.1 time: 0.055797 Jun 24 09:21:34.067835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1695/3097] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 09:21:34 2022] GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:34.079563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f1e9529d-c71b-45a2-aa2e-5b378f3e4570 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Action: 'create', calling method: .version_select at 0x7fa68c049430>, body: {"snapshot": {"volume_id": "d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1462088185"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:34.233695 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f1e9529d-c71b-45a2-aa2e-5b378f3e4570 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.157800 Jun 24 09:21:34.234298 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1403/3098] 10.222.0.48 () {60 vars in 1161 bytes} [Fri Jun 24 09:21:34 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:34.243908 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bd6c8077-1681-4d1c-a62b-8de642bf8254 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690139f70>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:34.276837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bd6c8077-1681-4d1c-a62b-8de642bf8254 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.035894 Jun 24 09:21:34.277491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1696/3099] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:34 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:34.287836 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1f2d70c8-8d79-468c-950b-7f38d7b2fdf9 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c0438b0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:34.317824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1f2d70c8-8d79-468c-950b-7f38d7b2fdf9 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034283 Jun 24 09:21:34.318549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1404/3100] 10.222.0.48 () {58 vars in 1139 bytes} [Fri Jun 24 09:21:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:34.329007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bfb05462-50f0-4f98-9fbc-77367a8e91c1 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690139d30>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:34.358725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bfb05462-50f0-4f98-9fbc-77367a8e91c1 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.033514 Jun 24 09:21:34.359308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1697/3101] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:34 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:35.028045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:35.028652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:35.035402 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:35.035846 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:35.036603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:35.037036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:35.161035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:35.168555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-451798a6-9509-43a0-bb7c-a5f363de4aae tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.145504 Jun 24 09:21:35.169119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1405/3102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:35 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:35.371341 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-62ecfbff-8f78-4c00-a837-9b0576e83568 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa69015e430>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:35.403739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-62ecfbff-8f78-4c00-a837-9b0576e83568 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.037181 Jun 24 09:21:35.407484 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1698/3103] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:35 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:36.184370 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:36.184982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:36.191440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:36.191882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:36.192639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:36.193070 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:36.329493 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:36.337647 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a7e9811c-1170-4487-81a8-e932b907080e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.157186 Jun 24 09:21:36.338283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1406/3104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:36 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:36.415981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b1077b3-dc9a-4f79-a451-9ac61341adc9 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c09b670>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:36.445957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b1077b3-dc9a-4f79-a451-9ac61341adc9 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.034392 Jun 24 09:21:36.446503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1699/3105] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:36 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:37.355036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:37.355640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:37.357565 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:37.358237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=10 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:37.364480 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:37.364924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:37.365702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:37.366137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:37.454524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:37.459443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-42099529-3d68-425b-90b8-368f0de16409 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa6877d2160>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:37.488858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-42099529-3d68-425b-90b8-368f0de16409 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.035112 Jun 24 09:21:37.489554 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1700/3106] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:37 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:21:37.492795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:37.500294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-20fee1b6-ab06-445c-b865-cecbd7dc6810 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.149754 Jun 24 09:21:37.500850 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1407/3107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:37 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:38.501254 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0928d381-339b-4c0d-ab53-5e75ef6c9413 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690156040>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:38.516877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:38.517501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:38.523895 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:38.524349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:38.525119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:38.525595 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:38.531654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0928d381-339b-4c0d-ab53-5e75ef6c9413 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.034568 Jun 24 09:21:38.532219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1701/3108] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:38 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:38.653458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:38.660925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a9ebf8da-7c5b-417e-b631-b6775a7d1274 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.148166 Jun 24 09:21:38.661489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1408/3109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:38 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:39.544249 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ac27a7a-a3b1-4a0e-84e9-d1bfedabdfd6 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690156dc0>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:39.573589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ac27a7a-a3b1-4a0e-84e9-d1bfedabdfd6 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 288 microversion: 2.1 time: 0.034519 Jun 24 09:21:39.574189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1702/3110] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:39 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:39.584067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0876dffc-3e2d-476f-ae81-d85e72004a9a tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c223940>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:39.641936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0876dffc-3e2d-476f-ae81-d85e72004a9a tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 202 len: 0 microversion: 2.1 time: 0.061474 Jun 24 09:21:39.642500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1409/3111] 10.222.0.48 () {58 vars in 1253 bytes} [Fri Jun 24 09:21:39 2022] DELETE /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:21:39.650551 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51ac6afb-1084-41ea-b1b1-79d86532979c tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690139b80>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:39.678719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:39.679348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:39.679925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-51ac6afb-1084-41ea-b1b1-79d86532979c tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 200 len: 287 microversion: 2.1 time: 0.033070 Jun 24 09:21:39.680485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1703/3112] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:39 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:39.685484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:39.685984 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:39.686752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:39.687193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:39.827874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:39.836441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-066b7ab0-82a3-42a5-892e-7773a3622202 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.161724 Jun 24 09:21:39.837040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1410/3113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:39 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:40.692148 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3df4eebe-67b2-4f75-ab1c-7824755c459e tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c0d81f0>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:40.717732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-3df4eebe-67b2-4f75-ab1c-7824755c459e tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] HTTP exception thrown: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3df4eebe-67b2-4f75-ab1c-7824755c459e tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Request method failure captured: Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 HTTP/1.1 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIcfZTXOKLU2KOGztjEiSra384qW9wqmAyC_pc_Elp1TDHgVlkEFxntzAtD1cvEFQPfYYPRcmYYLt6W3uKAEhy2nUINZgTK_3EuecBRvM0M4g1jb5arviBZEbUdIEwGM62OCNSKWColCTn5Ru2yB5lHQCKAiV5Co-C844bMGuUSsl4 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:40.721175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: ebdd9a22a13c4e86a4c03255e30391aa Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '0a71a4e8-ba2e-4735-a36d-0f72dacca506'} Jun 24 09:21:40.722949 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. (HTTP 404) (Request-ID: req-66c661dc-ab70-4061-9540-b2e0b57b92cc) Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.724030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:40.725804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 09:21:40.727546 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3df4eebe-67b2-4f75-ab1c-7824755c459e tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Returning 404 to user: Snapshot 0a71a4e8-ba2e-4735-a36d-0f72dacca506 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:40.729130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3df4eebe-67b2-4f75-ab1c-7824755c459e tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506" status: 404 len: 111 microversion: 2.1 time: 0.035299 Jun 24 09:21:40.730307 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1704/3114] 10.222.0.48 () {58 vars in 1250 bytes} [Fri Jun 24 09:21:40 2022] GET /compute/v2.1/os-snapshots/0a71a4e8-ba2e-4735-a36d-0f72dacca506 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:40.735333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7661b2f3-5291-4741-88d0-8ae6f180f6f7 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa6900833a0>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:40.796330 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7661b2f3-5291-4741-88d0-8ae6f180f6f7 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 202 len: 0 microversion: 2.1 time: 0.064661 Jun 24 09:21:40.796971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1411/3115] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:21:40 2022] DELETE /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:21:40.808762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a9231a9a-6798-4a61-9f1f-b4d65620ba88 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c4a1280>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:40.852982 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:40.853607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:40.854655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a9231a9a-6798-4a61-9f1f-b4d65620ba88 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 200 len: 344 microversion: 2.1 time: 0.052593 Jun 24 09:21:40.855223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1705/3116] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 09:21:40 2022] GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:40.860364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:40.860817 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:40.861576 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:40.862095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:40.988180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:40.996380 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8b9ffd2d-d098-4897-92dc-4056cf8c83ba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.147430 Jun 24 09:21:40.996946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1412/3117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:40 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:21:41.455248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-9eca8d3f-0b01-458d-b58a-c52624c51b48 req-0c7aca90-88a2-4119-9071-572e16949a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e110c88-8145-4331-a023-db93d115ea78", "name": "network-vif-plugged", "status": "completed", "tag": "ab177315-e080-44e4-a9b0-2c51e445a027"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:41.463470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9eca8d3f-0b01-458d-b58a-c52624c51b48 req-0c7aca90-88a2-4119-9071-572e16949a66 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:41.463909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-9eca8d3f-0b01-458d-b58a-c52624c51b48 req-0c7aca90-88a2-4119-9071-572e16949a66 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:41.475107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-9eca8d3f-0b01-458d-b58a-c52624c51b48 req-0c7aca90-88a2-4119-9071-572e16949a66 service nova] Creating event network-vif-plugged:ab177315-e080-44e4-a9b0-2c51e445a027 for instance 0e110c88-8145-4331-a023-db93d115ea78 on hv-cinder-78729 Jun 24 09:21:41.481437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-9eca8d3f-0b01-458d-b58a-c52624c51b48 req-0c7aca90-88a2-4119-9071-572e16949a66 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029671 Jun 24 09:21:41.482316 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1706/3118] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:41.867093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-912eff13-f744-491c-9813-c2765f9f7d10 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c223940>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:41.894299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-912eff13-f744-491c-9813-c2765f9f7d10 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] HTTP exception thrown: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-912eff13-f744-491c-9813-c2765f9f7d10 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Request method failure captured: Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 HTTP/1.1 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYIcfZTXOKLU2KOGztjEiSra384qW9wqmAyC_pc_Elp1TDHgVlkEFxntzAtD1cvEFQPfYYPRcmYYLt6W3uKAEhy2nUINZgTK_3EuecBRvM0M4g1jb5arviBZEbUdIEwGM62OCNSKWColCTn5Ru2yB5lHQCKAiV5Co-C844bMGuUSsl4 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:41.896323 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: ebdd9a22a13c4e86a4c03255e30391aa Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'd9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2'} Jun 24 09:21:41.898160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. (HTTP 404) (Request-ID: req-ff681463-53a0-4c15-ae3b-d1f9a69bb114) Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.899441 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:41.902076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:21:41.904150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-912eff13-f744-491c-9813-c2765f9f7d10 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Returning 404 to user: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-912eff13-f744-491c-9813-c2765f9f7d10 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 404 len: 109 microversion: 2.1 time: 0.034464 Jun 24 09:21:41.906403 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1413/3119] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 09:21:41 2022] GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:41.913283 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47bd43b9-d789-4556-90ac-11ff7717810b tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa690139d30>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:41.941343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-47bd43b9-d789-4556-90ac-11ff7717810b tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] HTTP exception thrown: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47bd43b9-d789-4556-90ac-11ff7717810b tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Request method failure captured: Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 HTTP/1.1 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIcfZTXOKLU2KOGztjEiSra384qW9wqmAyC_pc_Elp1TDHgVlkEFxntzAtD1cvEFQPfYYPRcmYYLt6W3uKAEhy2nUINZgTK_3EuecBRvM0M4g1jb5arviBZEbUdIEwGM62OCNSKWColCTn5Ru2yB5lHQCKAiV5Co-C844bMGuUSsl4 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:21:41.943451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: ebdd9a22a13c4e86a4c03255e30391aa Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': 'd9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2'} Jun 24 09:21:41.945256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. (HTTP 404) (Request-ID: req-ecff1a7a-3cf9-4200-a7e2-935d1d7d9906) Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.946413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 09:21:41.948375 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 09:21:41.950014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-47bd43b9-d789-4556-90ac-11ff7717810b tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Returning 404 to user: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-47bd43b9-d789-4556-90ac-11ff7717810b tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 404 len: 109 microversion: 2.1 time: 0.036229 Jun 24 09:21:41.951741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1707/3120] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:21:41 2022] DELETE /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:41.953180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e93ee44a-fc0a-4917-9894-269ca6e0fd92 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Calling method '.version_select at 0x7fa68c049430>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:41.981119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-e93ee44a-fc0a-4917-9894-269ca6e0fd92 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] HTTP exception thrown: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e93ee44a-fc0a-4917-9894-269ca6e0fd92 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Request method failure captured: Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 HTTP/1.1 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYIcfZTXOKLU2KOGztjEiSra384qW9wqmAyC_pc_Elp1TDHgVlkEFxntzAtD1cvEFQPfYYPRcmYYLt6W3uKAEhy2nUINZgTK_3EuecBRvM0M4g1jb5arviBZEbUdIEwGM62OCNSKWColCTn5Ru2yB5lHQCKAiV5Co-C844bMGuUSsl4 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:21:41.983256 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e5c43d0e6cee4836be51f97d27840497"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: e5c43d0e6cee4836be51f97d27840497 Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-991234582 Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: ebdd9a22a13c4e86a4c03255e30391aa Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesSnapshotsTestJSON-991234582-project Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'd9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2'} Jun 24 09:21:41.985135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. (HTTP 404) (Request-ID: req-cf783233-7bc0-4f70-8a7a-34ea70aa8961) Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.986416 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 09:21:41.988238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 09:21:41.989839 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e93ee44a-fc0a-4917-9894-269ca6e0fd92 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] Returning 404 to user: Volume d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e93ee44a-fc0a-4917-9894-269ca6e0fd92 tempest-VolumesSnapshotsTestJSON-991234582 tempest-VolumesSnapshotsTestJSON-991234582-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2" status: 404 len: 109 microversion: 2.1 time: 0.035304 Jun 24 09:21:41.991897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1414/3121] 10.222.0.48 () {58 vars in 1244 bytes} [Fri Jun 24 09:21:41 2022] GET /compute/v2.1/os-volumes/d9a68e1f-81dc-4fd7-a4a3-4685cf9e04b2 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 09:21:42.012799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:42.013556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:42.020459 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:42.020913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:42.021683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:42.022136 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:42.160048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:42.168279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-07e6f601-41a1-4578-a05d-1956feda286a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.159264 Jun 24 09:21:42.168837 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1708/3122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:42 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:43.186627 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:43.187270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:43.193200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:43.193651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:43.194447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:43.194885 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:43.345974 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:43.353413 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-63b077f3-ca54-4b33-86ee-bd689d7f690f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1363 microversion: 2.1 time: 0.171854 Jun 24 09:21:43.354539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1415/3123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:43 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:44.372131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:44.372792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:44.375017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:44.380755 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:44.381200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:44.382030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:44.382462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:44.514967 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:21:44.522479 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4b876172-4bf5-46ff-8643-2eeb528a4c09 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1548 microversion: 2.1 time: 0.155598 Jun 24 09:21:44.523045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1709/3124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:21:44 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:21:44.538734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:21:44.539488 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:21:44.546425 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:44.546876 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:44.547640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:44.548077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:44.623212 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5ac34b8a-042d-48c2-bde9-f482652db134 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088272 Jun 24 09:21:44.623802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1416/3125] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 09:21:44 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:21:45.679538 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-364b540e-d881-432b-bf7b-5868d4cc230e req-4ec56c5c-251c-4041-9bce-f64270d60757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e110c88-8145-4331-a023-db93d115ea78", "tag": "ab177315-e080-44e4-a9b0-2c51e445a027"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:21:45.691117 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-364b540e-d881-432b-bf7b-5868d4cc230e req-4ec56c5c-251c-4041-9bce-f64270d60757 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:21:45.691556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-364b540e-d881-432b-bf7b-5868d4cc230e req-4ec56c5c-251c-4041-9bce-f64270d60757 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:21:45.703866 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-364b540e-d881-432b-bf7b-5868d4cc230e req-4ec56c5c-251c-4041-9bce-f64270d60757 service nova] Creating event network-changed:ab177315-e080-44e4-a9b0-2c51e445a027 for instance 0e110c88-8145-4331-a023-db93d115ea78 on hv-cinder-78729 Jun 24 09:21:45.709088 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-364b540e-d881-432b-bf7b-5868d4cc230e req-4ec56c5c-251c-4041-9bce-f64270d60757 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184115 Jun 24 09:21:45.710246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1710/3126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:22:57.078076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:57.078903 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=69 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:57.084409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:22:57.084902 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:22:57.092988 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:57.093431 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:57.094219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:57.094653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:57.117725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5e82cd93-9149-47e4-af89-e133bc29dd43 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/ips" status: 200 len: 153 microversion: 2.20 time: 0.041683 Jun 24 09:22:57.118274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1417/3127] 10.222.0.48 () {60 vars in 1288 bytes} [Fri Jun 24 09:22:57 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:22:59.069499 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:59.070280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=67 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:59.074615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:22:59.075222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:22:59.082693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:59.083146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:59.083893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:59.084322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:59.106133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lazy-loading 'flavor' on Instance uuid 2c1af302-0abd-4780-b06b-ac8136aa7312 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:22:59.358239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5c83e73b-d806-484f-b3cc-271782dc0080 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/action" status: 202 len: 0 microversion: 2.20 time: 0.290293 Jun 24 09:22:59.358920 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1711/3128] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 24 09:22:59 2022] POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:22:59.366973 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:22:59.367613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:22:59.375465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:59.375929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:59.376705 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:22:59.377147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:22:59.515266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:22:59.523606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:22:59.525101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:22:59.526296 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-03e47ed9-fee6-4e6d-ad13-ffd4c3c88ab5 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.163265 Jun 24 09:22:59.526852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1418/3129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:22:59 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:00.546523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:00.547216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:00.553449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:00.553926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:00.554684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:00.555121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:00.679488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:00.687798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:00.689291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:00.690470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-776ce6fa-b0d0-4f21-b9fe-0abf2e30fc1a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.148814 Jun 24 09:23:00.691029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1712/3130] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:00 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:01.708702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:01.709300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:01.715791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:01.716229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:01.717578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:01.718031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:01.847611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:01.855381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:01.856856 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:01.858074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f1303d69-fe80-4177-941c-1a4e894918b4 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.153292 Jun 24 09:23:01.858630 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1419/3131] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:01 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:02.876133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:02.876684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:02.883189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:02.883638 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:02.884389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:02.884825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:03.011123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:03.019271 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:03.020862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:03.022059 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-04801584-6e8e-4204-ae61-18640489ffce tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.149878 Jun 24 09:23:03.022612 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1713/3132] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:02 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:04.040598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:04.041200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:04.048082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:04.048527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:04.049855 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:04.050373 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:04.184059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:04.192697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:04.194230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:04.195386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1e424aa8-ba7c-425c-9767-bbdea509ecb2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.159009 Jun 24 09:23:04.195944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1420/3133] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:04 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:05.213193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:05.213877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:05.220263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:05.220707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:05.221461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:05.221923 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:05.347402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:05.355251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:05.356750 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:05.357924 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e57c62d6-cca6-49d8-8a43-d21785beb935 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.148648 Jun 24 09:23:05.358478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1714/3134] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:05 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:06.375230 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:06.375871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:06.382454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:06.382911 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:06.383684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:06.384116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:06.513983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:06.521934 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:06.523414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:06.524558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-57babfe0-9a6a-4bbc-84f0-619caa2e36ee tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.153253 Jun 24 09:23:06.525106 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1421/3135] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:06 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:07.543806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:07.544389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:07.550786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:07.551226 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:07.551975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:07.552399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:07.680326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:07.688760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:07.690285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:07.691422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-892c3104-c453-4fc0-ad05-646acef7181e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.151518 Jun 24 09:23:07.691971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1715/3136] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:07 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:08.709535 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:08.710101 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:08.716720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:08.717169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:08.717957 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:08.718396 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:08.844128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:08.851915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:08.854474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:08.855638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-928141b8-be9b-4335-99ee-74186387f125 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.150041 Jun 24 09:23:08.856193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1422/3137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:08 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:09.874167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:09.874724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:09.881218 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:09.881691 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:09.882451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:09.882887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:10.010705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:10.018562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:10.020045 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:10.021195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3ff89623-f6c9-4e57-9301-b145182c5f51 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.151539 Jun 24 09:23:10.021769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1716/3138] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:09 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:11.039459 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:11.040049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:11.046573 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:11.047022 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:11.047777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:11.048207 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:11.179095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:11.188104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:11.189643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:11.190860 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eafa016a-eb46-4f59-95fc-59f95a13e325 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.155512 Jun 24 09:23:11.191419 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1423/3139] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:11 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:12.208826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:12.209430 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:12.216012 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:12.217084 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:12.217890 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:12.218332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:12.346253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:12.354025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:12.355518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:12.356675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-cdacef63-01f1-4ef0-adec-d87eb6757869 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1746 microversion: 2.20 time: 0.151784 Jun 24 09:23:12.357236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1717/3140] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:12 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:13.323598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:13.324189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:13.331238 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:13.331690 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:13.332452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:13.332891 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:13.356218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-538c7b46-ebd4-41b3-8ce4-d0b5ea2c08d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/ips" status: 200 len: 143 microversion: 2.1 time: 0.036529 Jun 24 09:23:13.356776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1424/3141] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:23:13 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/ips => generated 143 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:23:13.374520 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:13.375127 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:13.381418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:13.381898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:13.382651 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:13.383112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:13.510689 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:13.519494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:13.520993 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:13.523223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ff6eeee5-3dc0-4360-853e-73a8e1936a94 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1746 microversion: 2.20 time: 0.152094 Jun 24 09:23:13.523223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1718/3142] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:13 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:14.540711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:14.541322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:14.547777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:14.548221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:14.548972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:14.549399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:14.673289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:14.681169 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:14.682677 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:14.683816 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eeb123f0-32f2-4883-a41c-ef665dde73d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1746 microversion: 2.20 time: 0.147353 Jun 24 09:23:14.684364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1425/3143] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:14 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:15.660873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-d1272164-3055-4ddd-a9a9-eb069e2719bf req-fbf25f4e-e9fb-44c9-bb10-244992287987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "name": "network-vif-plugged", "status": "completed", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:15.669771 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-d1272164-3055-4ddd-a9a9-eb069e2719bf req-fbf25f4e-e9fb-44c9-bb10-244992287987 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:15.670228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-d1272164-3055-4ddd-a9a9-eb069e2719bf req-fbf25f4e-e9fb-44c9-bb10-244992287987 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:15.681793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-d1272164-3055-4ddd-a9a9-eb069e2719bf req-fbf25f4e-e9fb-44c9-bb10-244992287987 service nova] Creating event network-vif-plugged:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:23:15.687854 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-d1272164-3055-4ddd-a9a9-eb069e2719bf req-fbf25f4e-e9fb-44c9-bb10-244992287987 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030613 Jun 24 09:23:15.688446 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1719/3144] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:23:15.703162 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:15.703830 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:15.710271 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:15.710719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:15.711474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:15.711907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:15.845023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:15.853030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:15.854585 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:15.855782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-fcc5670f-1b4f-4397-8b1c-3b40f7c4d97c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1746 microversion: 2.20 time: 0.157265 Jun 24 09:23:15.856332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1426/3145] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:15 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:16.874982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:16.875591 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:16.881793 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:16.882242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:16.882995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:16.883427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:17.010476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:17.018315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:17.019820 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:17.021006 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-887ded13-c86e-430e-90a2-f4815da97e8d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1746 microversion: 2.20 time: 0.150775 Jun 24 09:23:17.021743 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1720/3146] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:16 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:17.398490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9c8da65-8c19-46ae-be71-be8ee117938a"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:17.399779 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:17.406871 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:17.407319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:17.408085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:17.408522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:17.653905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ec7a1979-32a2-40bb-a951-191dcec70d92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259165 Jun 24 09:23:17.659003 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1427/3147] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 09:23:17 2022] POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:23:18.040544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:18.041222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:18.048093 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:18.048794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:18.049550 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:18.050008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:18.190584 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:18.198822 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:18.200319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:18.201480 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-81222a52-ea95-4d2d-93de-dfd78c6d738d tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.165809 Jun 24 09:23:18.202057 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1721/3148] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:18 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:19.221435 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:19.222975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:19.229699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:19.230269 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:19.231332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:19.232031 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:19.383157 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:19.392460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:19.394108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:19.395358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d066b275-f6de-4f84-aebb-5e96c7002c90 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.178789 Jun 24 09:23:19.402019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1428/3149] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:19 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:20.413387 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:20.414434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:20.421565 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:20.422172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:20.423137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:20.423895 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:20.575816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:20.589338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:20.591219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:20.592696 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-830ca662-c61e-4ab8-8712-383e00c679df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.183388 Jun 24 09:23:20.593456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1722/3150] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:20 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:21.611944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:21.612494 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:21.619333 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:21.619904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:21.620789 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:21.621369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:21.758765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:21.767554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:21.769048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:21.770252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6e741a42-a44c-429b-83a8-c9e4fdd806b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.162364 Jun 24 09:23:21.774783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1429/3151] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:21 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:22.787946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:22.788549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:22.795374 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:22.795825 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:22.797180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:22.797631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:22.932389 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:22.940615 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:22.942135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:22.943291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d9e6e738-6ab6-423a-b80e-b00cd0be13eb tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.159256 Jun 24 09:23:22.943850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1723/3152] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:22 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:23.961743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:23.962315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:23.968672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:23.969116 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:23.969912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:23.970346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:24.379260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:24.387465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:24.389315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:24.390746 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9ca5fbe4-9cc5-4773-84e1-d98273038fca tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.432866 Jun 24 09:23:24.391512 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1430/3153] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:23 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:25.219037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-def82d71-2f58-43bb-99fa-73bd11fbeb9e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:25.226965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-def82d71-2f58-43bb-99fa-73bd11fbeb9e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:25.227758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-def82d71-2f58-43bb-99fa-73bd11fbeb9e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:25.290415 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-def82d71-2f58-43bb-99fa-73bd11fbeb9e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Going to try to stop instance {{(pid=124404) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 09:23:25.339712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-def82d71-2f58-43bb-99fa-73bd11fbeb9e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action" status: 202 len: 0 microversion: 2.1 time: 0.124713 Jun 24 09:23:25.340601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1724/3154] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 09:23:25 2022] POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:23:25.349900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:25.350518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:25.358221 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:25.358778 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:25.360407 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:25.361143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:25.410452 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:25.411607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:25.427031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:25.427795 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:25.428569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:25.429008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:25.433354 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:25.527897 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:25.537082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d4a7133e-dcf3-4363-a62a-e3298bb7e785 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.191618 Jun 24 09:23:25.538742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1431/3155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:25 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:25.660720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:25.669228 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:25.670761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:25.672497 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c1d3c9ad-2fe4-45ba-88d9-02d874a91207 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.266487 Jun 24 09:23:25.673232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1725/3156] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:25 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:26.556329 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:26.557061 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:26.565184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:26.566955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:26.568465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:26.569087 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:26.691697 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:26.693204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:26.700588 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:26.701429 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:26.702481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:26.703315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:26.721732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:26.725536 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:26.730864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5de0bd08-07ad-4cc4-9252-c7d2da0e66e8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.178354 Jun 24 09:23:26.731452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1432/3157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:26 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:26.846646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:26.856377 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:26.858030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:26.859456 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f2b35131-31d0-430f-9411-1f4093b14abf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.172092 Jun 24 09:23:26.860437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1726/3158] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:26 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:27.749034 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:27.750292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:27.752664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=33 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:27.759304 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:27.759659 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:27.760432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:27.760870 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:27.878426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:27.879215 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:27.885762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:27.886289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:27.887125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:27.887635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:27.895246 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:27.903164 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-09046c0d-8231-432e-a3b6-3b2194b14b84 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.158815 Jun 24 09:23:27.903726 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1433/3159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:27 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:28.012872 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:28.020718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:28.022263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:28.023407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-165d8013-61ee-4ddb-9562-16688ecaabbe tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1741 microversion: 2.20 time: 0.149573 Jun 24 09:23:28.023957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1727/3160] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:27 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1741 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:28.920563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:28.921155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:28.927563 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:28.928035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:28.928803 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:28.929242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:29.044449 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:29.045064 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:29.052019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:29.052471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:29.053462 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:29.053922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:29.063147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:29.072262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8e825859-6cef-454c-8961-2321be2aa7e2 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.155552 Jun 24 09:23:29.073046 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1434/3161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:28 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:29.196077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:29.204137 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:29.205797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:29.207036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e3d4e767-6b16-48b2-8d3f-2804c5e7438e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1723 microversion: 2.20 time: 0.167825 Jun 24 09:23:29.207684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1728/3162] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:29 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:30.088198 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:30.088804 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:30.095920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:30.096363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:30.097113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:30.097544 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:30.225492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:30.226216 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:30.228669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=37 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:30.229811 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:30.233996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:30.234451 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:30.235224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:30.235662 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:30.237868 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-31cd196a-ccc8-463e-84e3-68198ddadd10 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.153437 Jun 24 09:23:30.238474 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1435/3163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:30 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:30.364760 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:30.372632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:30.374166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:30.375862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d796ea00-f3c4-46d1-b75b-da8eb60e0005 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1723 microversion: 2.20 time: 0.154334 Jun 24 09:23:30.376457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1729/3164] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:30 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:31.254994 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:31.255554 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:31.261990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.262440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.263201 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.263634 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.392838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:31.395385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:31.396053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:31.400887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-85066faf-4f40-4873-8da1-44cb8020989d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.149785 Jun 24 09:23:31.401458 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1436/3165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:31 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:31.403396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.404096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.404896 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.405384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.543766 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:31.551548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:31.553029 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:31.554213 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9690e0e7-af59-4f76-b552-b1c1e2cc70ed tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1726 microversion: 2.20 time: 0.163975 Jun 24 09:23:31.554764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1730/3166] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:31 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:31.571831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29f32d9a-8580-4762-901b-deeb946842dc"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:31.573107 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:31.579540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.579986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.580738 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.581173 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.724003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-4a04923f-93af-48be-9257-1e8030eb50e9 req-a88cac0b-0096-4362-9a03-0efe46f82357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "name": "network-vif-unplugged", "status": "completed", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:31.734838 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-4a04923f-93af-48be-9257-1e8030eb50e9 req-a88cac0b-0096-4362-9a03-0efe46f82357 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.735275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-4a04923f-93af-48be-9257-1e8030eb50e9 req-a88cac0b-0096-4362-9a03-0efe46f82357 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.749146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.compute.server_external_events [req-4a04923f-93af-48be-9257-1e8030eb50e9 req-a88cac0b-0096-4362-9a03-0efe46f82357 service nova] Unable to find a host for instance 2c1af302-0abd-4780-b06b-ac8136aa7312. Dropping event network-vif-unplugged {{(pid=124404) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 09:23:31.750681 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-4a04923f-93af-48be-9257-1e8030eb50e9 req-a88cac0b-0096-4362-9a03-0efe46f82357 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030470 Jun 24 09:23:31.751335 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1731/3167] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 09:23:31.856802 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c6b58f49-3e42-43c6-96e2-d25e3c40553b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289042 Jun 24 09:23:31.857399 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1437/3168] 10.222.0.48 () {62 vars in 1363 bytes} [Fri Jun 24 09:23:31 2022] POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:23:31.970526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:31.971024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:31.977159 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.977608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:31.978396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:31.978829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.220887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-49b0c482-aac4-4bfb-b626-413a1c193e1f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments/29f32d9a-8580-4762-901b-deeb946842dc" status: 202 len: 0 microversion: 2.20 time: 0.254752 Jun 24 09:23:32.221596 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1732/3169] 10.222.0.48 () {60 vars in 1456 bytes} [Fri Jun 24 09:23:31 2022] DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments/29f32d9a-8580-4762-901b-deeb946842dc => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:23:32.275742 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:32.276315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:32.283315 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.283764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.284521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.284952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.369624 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-4254061b-ba12-4b35-8e8b-7264aad1277f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/action" status: 202 len: 0 microversion: 2.20 time: 0.097708 Jun 24 09:23:32.370346 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1438/3170] 10.222.0.48 () {62 vars in 1318 bytes} [Fri Jun 24 09:23:32 2022] POST /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:23:32.379109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:32.379720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:32.386339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.386794 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.387884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.388018 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.420324 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:32.420938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:32.427200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.427646 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.428409 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:32.428840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:32.569306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:32.578646 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:32.580225 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:32.581463 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-be39d0a7-c431-418b-8077-b33ba797b752 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1674 microversion: 2.20 time: 0.206876 Jun 24 09:23:32.585640 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1733/3171] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:32 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:32.603652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:32.612231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1776ec10-02d2-4228-85cb-a4ab93487684 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.196506 Jun 24 09:23:32.612231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1439/3172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:32 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:23:33.600441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:33.601043 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:33.607576 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:33.608024 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:33.608792 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:33.609223 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:33.628405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:33.629140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:33.635602 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:33.636045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:33.636800 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:33.637227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:33.790232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:33.797972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:33.799453 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:33.800614 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-871f2c92-ab14-41af-91d8-ba1573677837 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1674 microversion: 2.20 time: 0.204121 Jun 24 09:23:33.801167 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1734/3173] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:33 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:33.810418 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:33.818237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-98b8c58f-e84c-44b5-be04-4eb5df65016f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.193620 Jun 24 09:23:33.818785 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1440/3174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:33 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:23:34.818966 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:34.819575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:34.826073 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:34.826559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:34.827313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:34.828385 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:34.835520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:34.836135 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:34.842490 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:34.842942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:34.843815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:34.844252 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:35.019320 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:35.027338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:35.028851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:35.030013 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:35.030192 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1b324959-5c31-40ad-ba5a-efb592c56e12 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1674 microversion: 2.20 time: 0.214980 Jun 24 09:23:35.030574 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1735/3175] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:34 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:35.038263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-632ec0da-7ab5-4a2f-ad64-6f42368c889b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.206502 Jun 24 09:23:35.039171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1441/3176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:34 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:23:36.048796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:36.049405 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:36.055752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:36.056209 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:36.056332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:36.056446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:36.057063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:36.057491 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:36.063666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:36.064150 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:36.064921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:36.065361 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:36.248248 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:36.251204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:36.256089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:36.257649 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:36.258927 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-85160214-ffd0-4ad7-b20f-f1f8d0c99052 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1674 microversion: 2.20 time: 0.214520 Jun 24 09:23:36.259065 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-13e35272-76e1-45b1-9817-167bf71a7397 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.206959 Jun 24 09:23:36.259503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1442/3177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:36 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:23:36.259617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1736/3178] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:36 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1674 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:37.276259 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:37.276860 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:37.277268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:37.277393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:37.283366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:37.283611 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:37.283812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:37.284054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:37.284570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:37.284799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:37.285009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:37.285229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:37.483570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:37.488494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:37.493108 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ec8765da-1f2f-4b62-a0a4-0b374e573762 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.220541 Jun 24 09:23:37.494171 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1443/3179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:37 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:37.497556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:37.499076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:37.500781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6fb73981-82f4-48a9-ba82-dac573e260df tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1674 microversion: 2.20 time: 0.227964 Jun 24 09:23:37.501319 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1737/3180] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:37 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:38.511515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:38.512204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:38.519711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:38.520236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:38.521015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:38.521454 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:38.650371 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:38.651407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:38.661524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:38.662553 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:38.663195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:38.663761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:38.670153 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:38.680388 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-db85d572-c51e-4482-a3e9-7635df597fdf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.172804 Jun 24 09:23:38.681455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1444/3181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:38 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:23:38.972211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:38.981862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:38.983461 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:38.985230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed818636-c7c2-48bc-8e5b-ab1578aa5c40 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.469694 Jun 24 09:23:38.986065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1738/3182] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:38 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:39.698831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:39.700062 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:39.707294 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:39.707745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:39.708515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:39.708948 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:39.853707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:39.857308 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:39.866086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-24a86d10-cc1c-4bc7-ab2d-9958cc180368 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.170287 Jun 24 09:23:39.866698 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1445/3183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:39 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:40.006922 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:40.007607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:40.018340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:40.018790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:40.019556 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:40.019983 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:40.159693 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:40.168183 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:40.169712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:40.171123 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-06f8c91c-b806-446a-b8c5-6383724acb2c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.168292 Jun 24 09:23:40.172845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1739/3184] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:40 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:40.887067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:40.887622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:40.896051 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:40.896500 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:40.897265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:40.897722 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:41.036782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:41.045501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3b364dba-2141-4432-9cbe-17eb7a02963d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.165034 Jun 24 09:23:41.046104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1446/3185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:40 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:41.191487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:41.192154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:41.199203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:41.199998 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:41.200994 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:41.201632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:41.204845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:41.339488 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:41.349217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:41.351941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:41.353916 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-15c35a1c-70a7-4e98-b866-e518300fd7b1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.167041 Jun 24 09:23:41.354561 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1740/3186] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:41 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:42.063283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:42.064078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:42.070813 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:42.071567 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:42.072588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:42.072964 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:42.211412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:42.219438 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6739ead3-030d-4004-832e-8304918fccac tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.159984 Jun 24 09:23:42.220215 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1447/3187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:42 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:42.372732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:42.374102 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:42.381613 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:42.382118 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:42.382933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:42.383396 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:42.523965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:42.533157 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:42.535019 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:42.536518 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-58c6bbdd-7bc8-475c-86a4-b876de51db84 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.167805 Jun 24 09:23:42.537296 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1741/3188] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:42 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:43.238192 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:43.238912 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:43.245066 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:43.245520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:43.246348 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:43.246783 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:43.385412 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:43.399007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-76ce5516-0c6b-4fbb-92ff-dbcc52106ec3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.165340 Jun 24 09:23:43.399588 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1448/3189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:43 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:43.556285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:43.557770 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:43.565166 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:43.565788 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:43.566661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:43.567239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:43.703655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:43.711718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:43.713239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:43.714851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d440b635-0b44-4d10-a2ff-af3003d0d33a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.162510 Jun 24 09:23:43.715930 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1742/3190] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:43 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:44.416581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:44.417904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:44.424697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:44.425520 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:44.426395 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:44.426831 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:44.595921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:44.604538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f2ee01a6-39e2-4c9d-b05e-60bcb43b7a37 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.192047 Jun 24 09:23:44.607175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1449/3191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:44 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:44.733311 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:44.733979 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:44.741206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:44.741678 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:44.742506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:44.742965 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:44.886332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:44.894707 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:44.896229 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:44.897403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86865218-d00b-4a1d-b1ae-bf5114070bcf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.168169 Jun 24 09:23:44.898180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1743/3192] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:44 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:45.622731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:45.623394 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:45.631427 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:45.631883 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:45.632685 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:45.633482 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:45.772384 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:45.780359 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-40bb248a-99fb-41cb-84ac-2d943078ecf6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.161543 Jun 24 09:23:45.780927 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1450/3193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:45 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:45.916555 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:45.917222 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:45.923880 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:45.924328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:45.925094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:45.925544 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:46.069454 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:46.077741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:46.079903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:46.081098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b4f20cc0-ee28-4bb2-803d-2e924a627e7b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.168815 Jun 24 09:23:46.081655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1744/3194] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:45 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:46.798331 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:46.798991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:46.805748 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:46.806204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:46.806975 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:46.807414 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:46.940417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:46.948404 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b4a87ee5-dc1b-4aa7-92ce-e5b906e66d80 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.153965 Jun 24 09:23:46.949176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1451/3195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:46 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:47.099260 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:47.099851 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:47.106285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:47.106730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:47.107477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:47.107909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:47.236570 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:47.244799 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:47.246343 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:47.247505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3614f834-147a-4cc5-b073-9f7ac8e122a9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.152169 Jun 24 09:23:47.248066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1745/3196] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:47 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:47.967079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:47.967696 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:47.974689 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:47.975140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:47.975900 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:47.976340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:48.102732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:48.110639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-377f6589-48d2-4d04-8db2-868519b2f92a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.147475 Jun 24 09:23:48.111203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1452/3197] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:47 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:48.267189 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:48.267807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:48.274543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:48.274997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:48.275782 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:48.276220 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:48.400339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:48.408340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:48.409928 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:48.411149 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2ddd1ee1-86cb-47f3-9ba2-1ba14c665ff3 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.148463 Jun 24 09:23:48.411728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1746/3198] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:48 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:49.127743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:49.128360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:49.134792 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:49.135265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:49.136027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:49.136513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:49.267734 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:49.275578 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e9964da4-6de5-42e3-be0d-1228d00c40bc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.151786 Jun 24 09:23:49.276245 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1453/3199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:49 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:49.430128 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:49.430669 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:49.437050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:49.437498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:49.438288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:49.438719 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:49.563053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:49.571108 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:49.572601 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:49.573775 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fc4e2979-baa1-480d-b436-998ba9f3570e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.147572 Jun 24 09:23:49.574323 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1747/3200] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:49 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:50.293613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:50.294258 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:50.300234 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:50.300686 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:50.301442 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:50.301908 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:50.427834 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:50.435701 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1874e71a-eb58-4ecd-8dff-afc06272cc68 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.146420 Jun 24 09:23:50.436267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1454/3201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:50 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:50.592285 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:50.592816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:50.599291 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:50.599739 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:50.600493 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:50.600934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:50.729951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:50.738282 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:50.739764 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:50.740958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f0c79f3f-3812-423d-8d97-841b6e16d441 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.152676 Jun 24 09:23:50.741543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1748/3202] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:50 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:51.267175 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:23:51.267447 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:23:51.452452 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:51.453058 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:51.459629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:51.460072 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:51.460822 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:51.461253 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:51.587873 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:51.596385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-84969b9f-e42c-4c3f-8e60-59056606839f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.147768 Jun 24 09:23:51.596942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1455/3203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:51 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:51.768050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:51.768675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:51.775616 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:51.776090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:51.776884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:51.777330 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:51.919321 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:51.927122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:51.928627 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:51.929815 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ed6ba7fb-e5c4-45e0-95a7-98709b17b483 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.166963 Jun 24 09:23:51.930365 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1749/3204] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:51 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:52.614023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:52.614641 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:52.621127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:52.621586 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:52.622385 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:52.622826 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:52.746744 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:52.756714 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-62ac7bee-a11a-40be-8deb-198670dcf0f9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.146906 Jun 24 09:23:52.757643 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1456/3205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:52 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:52.948258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:52.948812 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:52.955444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:52.955891 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:52.956641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:52.957075 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:53.084725 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:53.092606 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:53.094754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:53.095906 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-adf67746-985f-4747-82c8-fe96c82dcf05 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.151613 Jun 24 09:23:53.096465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1750/3206] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:52 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:53.774492 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:53.775098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:53.781501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:53.781990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:53.782751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:53.783185 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:53.907600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:53.915716 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ee23880b-5914-49db-8935-bc531e52dee8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.145097 Jun 24 09:23:53.916281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1457/3207] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:53 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:54.114625 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:54.115142 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:54.121567 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:54.122048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:54.122806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:54.123239 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:54.250876 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:54.258789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:54.260289 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:54.261472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-091ce2f3-70ad-493f-bdbd-df5cf76f6f50 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.150780 Jun 24 09:23:54.262051 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1751/3208] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:54 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:54.932917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:54.933434 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:54.940338 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:54.940790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:54.941541 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:54.942082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:55.066933 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:55.074818 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-96d4e42a-575d-4d7e-8015-1c73621911ab tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1721 microversion: 2.1 time: 0.145860 Jun 24 09:23:55.075381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1458/3209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:54 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:55.279836 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:55.280445 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:55.286946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:55.287403 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:55.288169 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:55.288607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:55.415393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:55.423893 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:55.425409 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:55.426633 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-51686a96-c77b-4063-92e1-c1d0f84858d0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.150743 Jun 24 09:23:55.427190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1752/3210] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:55 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:23:56.092472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:56.093069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:56.100128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.100577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.101335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.101806 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.230683 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:56.238622 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-08885568-d876-4063-9b5a-27d60cbc7206 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1698 microversion: 2.1 time: 0.150056 Jun 24 09:23:56.239193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1459/3211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:56 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1698 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:56.255170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4f5ca4d5-936b-457a-96f3-fde39132726e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:23:56.261143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f5ca4d5-936b-457a-96f3-fde39132726e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.261586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4f5ca4d5-936b-457a-96f3-fde39132726e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.290221 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4f5ca4d5-936b-457a-96f3-fde39132726e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Going to try to start instance {{(pid=124404) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 09:23:56.330135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4f5ca4d5-936b-457a-96f3-fde39132726e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action" status: 202 len: 0 microversion: 2.1 time: 0.078609 Jun 24 09:23:56.330729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1753/3212] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 09:23:56 2022] POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:23:56.338599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:56.339210 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:56.346049 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.346489 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.347262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.347720 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.445981 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:56.446683 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:56.453427 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.453926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.454695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:56.455133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:56.473487 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:56.481325 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-cb6e8130-a99e-4301-86ef-30542b3e7e5e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1707 microversion: 2.1 time: 0.146526 Jun 24 09:23:56.481917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1460/3213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:56 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1707 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:56.585796 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:56.593559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:56.595065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:56.596258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7af8cacc-5160-49b0-acea-7eb461169d4e tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.154557 Jun 24 09:23:56.596757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1754/3214] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:56 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:57.498347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:57.498955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:57.505366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:57.505845 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:57.506598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:57.507028 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:57.616393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:57.617002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:57.623138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:57.623586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:57.624339 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:57.624846 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:57.632899 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:57.641611 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7e30aa5a-ad48-4af8-94ad-c33285a0a96f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1707 microversion: 2.1 time: 0.146997 Jun 24 09:23:57.642242 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1461/3215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:57 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1707 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:57.755007 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:57.757267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:57.763991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:57.766062 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:57.767193 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a58d1e93-3b95-44dc-8137-ff03cc43976b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.156633 Jun 24 09:23:57.767736 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1755/3216] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:57 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:58.662888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:58.663501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:58.666093 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=60 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:58.672052 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:58.672519 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:58.673281 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:58.673745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:58.691214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=100 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:58.785902 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:58.786510 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:58.794988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:58.795439 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:58.796211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:58.797217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:58.804405 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:58.812264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-5675be54-dd2e-4532-86e3-980f4c019916 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1707 microversion: 2.1 time: 0.153218 Jun 24 09:23:58.821936 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1462/3217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:58 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:23:58.922636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:58.930470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:58.931982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:58.933140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d4d59055-406e-4126-90df-33f99ae2cf19 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.151193 Jun 24 09:23:58.933708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1756/3218] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:58 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:23:59.829549 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:59.830319 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:59.836650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:59.837095 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:59.837889 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:59.838318 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:59.950936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:23:59.951728 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:23:59.958505 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:59.959082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:59.959972 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:23:59.960523 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:23:59.982907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:23:59.992510 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e37f02b3-9bb8-45fa-a31e-6abcb31f5cfb tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1711 microversion: 2.1 time: 0.166775 Jun 24 09:23:59.993094 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1463/3219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:23:59 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:24:00.089087 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:00.097543 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:00.099119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:00.100253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b7cc89b0-9559-47e2-b2e5-148d677de8aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.153244 Jun 24 09:24:00.100809 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1757/3220] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:23:59 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:24:01.118981 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:24:01.119592 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:24:01.126558 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:01.127007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:01.127773 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:01.128214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:01.256247 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:01.264194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:01.266026 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:01.268081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a3fc40e0-db91-48df-94cf-ba16bc6efda0 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.152745 Jun 24 09:24:01.268780 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1464/3221] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:24:01 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:24:01.897535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-437c351d-57e8-4e7b-8672-ec6d871fcddc req-b82fe6bd-dfdd-4d0f-8ad1-70e95231f858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "name": "network-vif-plugged", "status": "completed", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:24:01.902589 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=58 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:24:01.907361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-437c351d-57e8-4e7b-8672-ec6d871fcddc req-b82fe6bd-dfdd-4d0f-8ad1-70e95231f858 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:01.907806 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-437c351d-57e8-4e7b-8672-ec6d871fcddc req-b82fe6bd-dfdd-4d0f-8ad1-70e95231f858 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:01.920381 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-437c351d-57e8-4e7b-8672-ec6d871fcddc req-b82fe6bd-dfdd-4d0f-8ad1-70e95231f858 service nova] Creating event network-vif-plugged:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:24:01.926026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-437c351d-57e8-4e7b-8672-ec6d871fcddc req-b82fe6bd-dfdd-4d0f-8ad1-70e95231f858 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032142 Jun 24 09:24:01.926699 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1758/3222] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:24:02.287967 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:24:02.288577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:24:02.295397 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:02.295844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:02.296604 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:02.297040 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:02.424882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:02.432712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:02.434225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:02.435369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5f61291-565b-4177-978e-aaaf813511cf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.151331 Jun 24 09:24:02.435924 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1465/3223] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:24:02 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:24:03.119949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:24:03.120332 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:24:03.455155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:24:03.455850 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:24:03.462049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:03.462486 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:03.463241 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:03.463675 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:03.588987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:03.596879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:03.598414 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:03.599569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-65ce25c0-f39c-448f-aaad-08abca6764be tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1732 microversion: 2.20 time: 0.150076 Jun 24 09:24:03.600122 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1759/3224] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:24:03 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:24:03.797704 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:24:03.797865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:24:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:24:04.617972 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:24:04.618579 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:24:04.625039 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:04.625484 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:04.626282 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:24:04.626709 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:24:04.758297 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:04.766260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:04.767750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:24:04.768898 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ee1db88-6d91-4ce5-8628-d2d17ebf966a tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1719 microversion: 2.20 time: 0.154843 Jun 24 09:24:04.769448 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1466/3225] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:24:04 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:25:10.975636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:10.976306 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=21 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:10.981058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:10.981542 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:10.988840 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:10.989286 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:10.990065 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:10.990498 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:11.074124 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lazy-loading 'services' on Instance uuid 0e110c88-8145-4331-a023-db93d115ea78 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:25:11.144522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-50d3ee6d-4c0d-4bb5-a56f-dbe6e3bd7cb3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments/e9c8da65-8c19-46ae-be71-be8ee117938a" status: 202 len: 0 microversion: 2.1 time: 0.170588 Jun 24 09:25:11.145281 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1760/3226] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:25:10 2022] DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments/e9c8da65-8c19-46ae-be71-be8ee117938a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:25:11.816477 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=9 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:11.817228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=26 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:11.821743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:11.822750 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:11.829546 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:11.830015 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:11.830786 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:11.831222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:11.862854 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-93c1d606-e1a3-42fc-ae65-6d01c23ed657 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047950 Jun 24 09:25:11.863340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1467/3227] 10.222.0.48 () {60 vars in 1342 bytes} [Fri Jun 24 09:25:11 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:11.920273 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:11.920859 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:11.927797 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:11.928256 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:11.929053 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:11.929490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:11.954513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:25:12.026698 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2ac16b68-e55a-4924-b930-637b985db1c1 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 204 len: 0 microversion: 2.20 time: 0.110498 Jun 24 09:25:12.027417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1761/3228] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 24 09:25:11 2022] DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 09:25:12.035915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:12.036529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:12.042760 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:12.043214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:12.043983 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:12.044421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:12.177639 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:12.185501 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:12.187037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:12.188208 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e044cd6d-e739-4d22-9c07-22d3c4ac89a2 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.156706 Jun 24 09:25:12.188767 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1468/3229] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:12 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:25:13.207560 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:13.208247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:13.214275 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:13.214717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:13.215471 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:13.215897 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:13.314607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f9774261-b165-4a53-a071-b8ec2714d61e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:25:13.326257 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9774261-b165-4a53-a071-b8ec2714d61e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:13.326739 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f9774261-b165-4a53-a071-b8ec2714d61e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:13.359258 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:13.367958 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:13.369587 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:13.370881 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53a3a88a-8866-49ba-8f35-7e43706f0fdf tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.168131 Jun 24 09:25:13.371512 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1762/3230] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:13 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:25:13.394433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f9774261-b165-4a53-a071-b8ec2714d61e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Going to try to stop instance {{(pid=124405) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 09:25:13.435460 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f9774261-b165-4a53-a071-b8ec2714d61e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action" status: 202 len: 0 microversion: 2.1 time: 0.126048 Jun 24 09:25:13.436048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1469/3231] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 09:25:13 2022] POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 09:25:13.444745 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:13.445349 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:13.451292 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:13.451740 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:13.452501 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:13.452940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:13.587369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:13.595008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1ee6c77a-11d1-4e3d-945d-8161b4e05433 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.154004 Jun 24 09:25:13.595597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1763/3232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:13 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:25:14.390656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:14.391349 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:14.397379 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:14.397864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:14.398625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:14.399053 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:14.529751 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:14.538200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:14.540016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a3be1ca51b0472eb1a23f9d052a3c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1228688aff08407bb65f0876f4de6249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:14.541267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-220ef326-2fc3-4250-a566-a88486a1f42b tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 200 len: 1725 microversion: 2.20 time: 0.155656 Jun 24 09:25:14.541861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1470/3233] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:14 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:25:14.613100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:14.613798 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:14.620679 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:14.621139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:14.622008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:14.622384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:14.757524 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:14.765313 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-41fe9ba9-c2b8-4364-87eb-734ddd611a92 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.156875 Jun 24 09:25:14.765917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1764/3234] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:14 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:14.998797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-daba96b0-3d9e-436c-b525-7e8f1b2fc952 req-c167758f-69ab-4454-bf0d-873a923cc5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1af302-0abd-4780-b06b-ac8136aa7312", "name": "network-vif-deleted", "tag": "1ba20646-9367-46ac-8ca5-a4c232518dfe"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:25:15.013067 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-daba96b0-3d9e-436c-b525-7e8f1b2fc952 req-c167758f-69ab-4454-bf0d-873a923cc5a3 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:15.013509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-daba96b0-3d9e-436c-b525-7e8f1b2fc952 req-c167758f-69ab-4454-bf0d-873a923cc5a3 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:15.025553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-daba96b0-3d9e-436c-b525-7e8f1b2fc952 req-c167758f-69ab-4454-bf0d-873a923cc5a3 service nova] Creating event network-vif-deleted:1ba20646-9367-46ac-8ca5-a4c232518dfe for instance 2c1af302-0abd-4780-b06b-ac8136aa7312 on hv-cinder-78729 Jun 24 09:25:15.030389 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-daba96b0-3d9e-436c-b525-7e8f1b2fc952 req-c167758f-69ab-4454-bf0d-873a923cc5a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035330 Jun 24 09:25:15.031327 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1471/3235] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:25:15.560404 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:15.561067 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:15.567867 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:15.569002 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:15.569230 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:15.570031 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:15.584253 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 HTTP/1.1 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:25:15.586036 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:15.589257 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '2c1af302-0abd-4780-b06b-ac8136aa7312'} Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:25:15.591048 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:15.595894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:15.597909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:25:15.597909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f793fd69-8acd-472b-bc09-c5cd2b8351aa tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 404 len: 111 microversion: 2.20 time: 0.031006 Jun 24 09:25:15.597909 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1765/3236] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:15 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:25:15.598206 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-80be2b8b-9bbd-4e16-a54f-71daef5fa10f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '.version_select at 0x7fa68c089a60>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:15.622654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-80be2b8b-9bbd-4e16-a54f-71daef5fa10f tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200151294" status: 204 len: 0 microversion: 2.20 time: 0.029639 Jun 24 09:25:15.623453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1472/3237] 10.222.0.48 () {60 vars in 1261 bytes} [Fri Jun 24 09:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200151294 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 09:25:15.783899 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:15.784522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:15.791635 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:15.792089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:15.792870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:15.793308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:15.935708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:15.944077 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c0299695-c4c8-4352-a08c-9561acc498f4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.164576 Jun 24 09:25:15.944652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1766/3238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:15 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:16.961237 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:16.961987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:16.969204 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:16.969718 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:16.970581 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:16.971127 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:17.114444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:17.122172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-ab37e285-8332-4bdc-b4a8-076559a98eaa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.164844 Jun 24 09:25:17.122737 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1473/3239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:16 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:17.422162 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:17.422598 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:17.430469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:17.430925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:17.431705 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:17.432144 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:17.445572 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 HTTP/1.1 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:25:17.447180 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.449039 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '2c1af302-0abd-4780-b06b-ac8136aa7312'} Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:25:17.450086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.451768 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.454503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:25:17.454503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1195cc17-eb12-47be-b668-3c9714ce46f9 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 404 len: 111 microversion: 2.20 time: 0.030827 Jun 24 09:25:17.454503 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1767/3240] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 24 09:25:17 2022] DELETE /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:25:17.457251 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:17.457896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 2c1af302-0abd-4780-b06b-ac8136aa7312] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:17.463756 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:17.464197 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:17.464977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:17.465406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:17.479232 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 HTTP/1.1 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:25:17.480798 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.482629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '2c1af302-0abd-4780-b06b-ac8136aa7312'} Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:25:17.483589 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. Jun 24 09:25:17.485181 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:17.487672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 2c1af302-0abd-4780-b06b-ac8136aa7312 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:25:17.487672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8351e97e-0147-41d1-a390-ce81b8d3506c tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312" status: 404 len: 111 microversion: 2.20 time: 0.029032 Jun 24 09:25:17.487672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1474/3241] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:17 2022] GET /compute/v2.1/servers/2c1af302-0abd-4780-b06b-ac8136aa7312 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:25:18.139569 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:18.140190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:18.146947 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.147401 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.148194 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.148634 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.289202 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:18.296763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-548f0d77-46bb-4aa8-acf8-cbb169269d31 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.161114 Jun 24 09:25:18.297326 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1768/3242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:18 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:18.616137 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:18.616618 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:18.623023 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.623470 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.624227 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.624661 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.638401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e HTTP/1.1 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:25:18.639925 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.641952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '6cb66bde-d133-41de-b6dd-295b0676be9e'} Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:25:18.643012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.644679 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.646382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:25:18.646382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-35ea9e31-6726-403b-a62d-d1a8e08df147 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 404 len: 111 microversion: 2.20 time: 0.028963 Jun 24 09:25:18.646382 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1475/3243] 10.222.0.48 () {60 vars in 1279 bytes} [Fri Jun 24 09:25:18 2022] DELETE /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:25:18.649731 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:18.650342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] [instance: 6cb66bde-d133-41de-b6dd-295b0676be9e] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:18.656732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.657174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.657950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:18.658384 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:18.673359 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] HTTP exception thrown: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Request method failure captured: Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e HTTP/1.1 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitXlR1lcXA2MU86-kK_DzD-smxNiqMIGhOVAnPuSet_4ZtuG3eIpTUPnkpe4SjA3zMnoMS87yY1J57Q0n2wOswFOGHZmhOGtkhINusIA0Cn9LuwiN8_jhG_D4yvFdLg-hsVcdzTRB3N-0nox2DHxlau6aZZUPJKLBYfV01W4Z2Hi_RAc Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:25:18.675410 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1228688aff08407bb65f0876f4de6249"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1228688aff08407bb65f0876f4de6249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1228688aff08407bb65f0876f4de6249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: 1228688aff08407bb65f0876f4de6249 Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-500885175 Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 0a3be1ca51b0472eb1a23f9d052a3c75 Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeShelveTestJSON-500885175-project Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.677293 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '6cb66bde-d133-41de-b6dd-295b0676be9e'} Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:25:18.678356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. Jun 24 09:25:18.680056 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:25:18.681549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] Returning 404 to user: Instance 6cb66bde-d133-41de-b6dd-295b0676be9e could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:25:18.681549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b0ab91f-b603-48f7-a406-c52cdea58324 tempest-AttachVolumeShelveTestJSON-500885175 tempest-AttachVolumeShelveTestJSON-500885175-project] 10.222.0.48 "GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e" status: 404 len: 111 microversion: 2.20 time: 0.030871 Jun 24 09:25:18.681549 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1769/3244] 10.222.0.48 () {60 vars in 1276 bytes} [Fri Jun 24 09:25:18 2022] GET /compute/v2.1/servers/6cb66bde-d133-41de-b6dd-295b0676be9e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 09:25:19.314032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:19.314650 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:19.320613 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:19.321069 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:19.321869 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:19.322313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:19.553930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:19.561369 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0a12eb12-f925-4112-872b-078c0b9d1394 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.251313 Jun 24 09:25:19.562155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1476/3245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:19 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:20.579754 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:20.580327 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:20.587519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:20.588287 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:20.589066 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:20.589500 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:20.803712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:20.812847 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-53bf1a6c-7949-4175-a0ac-1f43336d4475 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.237383 Jun 24 09:25:20.813426 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1770/3246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:20 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:21.835317 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:21.836218 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:21.843879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:21.844656 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:21.847223 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:21.848044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:22.005904 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:22.014200 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-879bbaab-1b6d-4d5c-ac9d-b415de007fe8 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.187283 Jun 24 09:25:22.015623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1477/3247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:21 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:23.030564 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:23.031140 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:23.037517 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:23.037995 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:23.039009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:23.039495 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:23.174206 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:23.181865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b148ad73-1ac6-47f1-8d8e-bbff96e77a97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.154987 Jun 24 09:25:23.182425 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1771/3248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:23 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:25:24.199123 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:24.199725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:24.206772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:24.207217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:24.207971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:24.208401 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:24.338250 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:24.345628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bcc603ec-6a76-4c7e-b205-4168f5663d65 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.150336 Jun 24 09:25:24.346219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1478/3249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:24 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:25.362590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:25.363367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:25.370181 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:25.370631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:25.371395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:25.371831 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:25.497858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:25.505826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-790b9a9d-ebb8-41b9-947c-7fd47d08dca7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.147609 Jun 24 09:25:25.506382 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1772/3250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:25 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:26.523539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:26.524142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:26.530570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:26.531016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:26.531763 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:26.532194 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:26.657213 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:26.664797 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-2e609d57-6941-4f89-b11b-a70ebda86ee4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.145046 Jun 24 09:25:26.665353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1479/3251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:26 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:27.682502 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:27.683040 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:27.689490 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:27.689973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:27.690734 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:27.691168 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:27.819009 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:27.826513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-34b45a6e-fa0f-49da-a8ec-f7f4ba1a0a52 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.147949 Jun 24 09:25:27.827071 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1773/3252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:27 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:28.844081 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:28.844688 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:28.851615 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:28.852059 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:28.852812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:28.853274 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:28.981570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:28.989098 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c5221a35-1d22-476f-90d7-0a6b42171e97 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1675 microversion: 2.1 time: 0.148860 Jun 24 09:25:28.989676 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1480/3253] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:28 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:30.011347 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:30.011954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:30.019096 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:30.019545 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:30.020297 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:30.020732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:30.148061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:30.155417 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-b0983e69-7fed-47ae-86bc-7b2fac9a1ba3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1652 microversion: 2.1 time: 0.147964 Jun 24 09:25:30.155977 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1774/3254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:30 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1652 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:30.172381 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8cc69874-a5a2-4226-8258-f3607a84aff7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:25:30.178835 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cc69874-a5a2-4226-8258-f3607a84aff7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:30.179283 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8cc69874-a5a2-4226-8258-f3607a84aff7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:30.200715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8cc69874-a5a2-4226-8258-f3607a84aff7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Going to try to start instance {{(pid=124405) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 09:25:30.239699 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8cc69874-a5a2-4226-8258-f3607a84aff7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action" status: 202 len: 0 microversion: 2.1 time: 0.070993 Jun 24 09:25:30.240285 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1481/3255] 10.222.0.48 () {60 vars in 1277 bytes} [Fri Jun 24 09:25:30 2022] POST /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:25:30.248346 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:30.249079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:30.255864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:30.256483 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:30.257392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:30.258050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:30.391887 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:30.399522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-989a2e7d-ca7a-430a-9d99-62b8375a3848 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1661 microversion: 2.1 time: 0.154973 Jun 24 09:25:30.400086 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1775/3256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:30 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1661 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:31.417503 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:31.418219 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:31.425300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:31.425300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:31.426016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:31.426447 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:31.563220 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:31.570674 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-8538546f-b572-4c8f-a784-52351ee11469 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1661 microversion: 2.1 time: 0.158023 Jun 24 09:25:31.571233 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1482/3257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:31 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:32.587049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:32.587663 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:32.594207 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:32.594655 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:32.595413 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:32.595868 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:32.599933 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:32.725808 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:32.733232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-24c994a6-1556-485a-8682-b1acf7407076 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1661 microversion: 2.1 time: 0.150071 Jun 24 09:25:32.733817 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1776/3258] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:32 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1661 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:33.751084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:33.751640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:33.758265 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:33.758715 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:33.759472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:33.759907 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:33.883969 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:33.891360 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bfed1705-b785-4181-96b6-193bf445752e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1661 microversion: 2.1 time: 0.144287 Jun 24 09:25:33.891920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1483/3259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:33 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1661 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:34.909008 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:34.909526 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:34.916312 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:34.916758 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:34.917511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:34.917971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:35.047870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:35.055278 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d0e4cc55-af04-43ef-a2b3-dfebc626a1d6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1661 microversion: 2.1 time: 0.150846 Jun 24 09:25:35.055829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1777/3260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:34 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1661 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:25:36.071518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:25:36.072128 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:25:36.078583 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:36.079036 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:36.080420 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:25:36.080864 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:25:36.098652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:36.362286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:25:36.369732 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-84006e57-4495-4410-ad35-4d6db6f8cfd4 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1665 microversion: 2.1 time: 0.302094 Jun 24 09:25:36.370299 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1484/3261] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:25:36 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1665 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:53.272940 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7ad48daf-b616-4db5-b149-516a124947a4] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 24 09:26:53.273492 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:53.274294 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=10 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:53.278934 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:53.279925 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:53.287533 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.287986 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.289016 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.289450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.318987 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-77719b8d-2443-4c46-897f-39109057e172 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047915 Jun 24 09:26:53.319818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1778/3262] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:26:53 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:26:53.379091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:53.379920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:53.384262 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:53.385142 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:53.393179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.393979 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.395570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.396366 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.426406 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:26:53.511635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-dcd7c125-73e8-481f-bf96-941eeb4ea0b3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 204 len: 0 microversion: 2.1 time: 0.134095 Jun 24 09:26:53.513465 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1485/3263] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:26:53 2022] DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:53.521888 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:53.522814 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:53.529028 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.529477 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.530266 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:53.530701 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:53.771322 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:53.779309 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-5b63792f-56c2-44ad-8081-0abd0d1b3bde tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1671 microversion: 2.1 time: 0.261644 Jun 24 09:26:53.779870 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1779/3264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:53 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1671 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:54.575992 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-796036896", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "networks": [{"uuid": "5fb987be-1bdc-4e2d-a76d-54869c1b9f08"}]}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:26:54.631888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] validate_networks() for [('5fb987be-1bdc-4e2d-a76d-54869c1b9f08', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:26:54.796904 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:54.797622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:54.805818 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:54.806331 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:54.807628 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:54.808070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:54.830519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] [7ad48daf-b616-4db5-b149-516a124947a4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33386. Jun 24 09:26:55.253536 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:55.262703 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-f3827c56-7dc8-4d49-8b3a-0b980cc21138 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1671 microversion: 2.1 time: 0.469728 Jun 24 09:26:55.263729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1780/3265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:54 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1671 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:26:55.343528 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:26:55.343949 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:26:55.344449 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:26:55.344857 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:26:55.345264 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:26:55.356165 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:55.356599 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:55.357481 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:55.357946 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:55.375222 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Getting quotas for project 60ce37b8317a4c2dbd096f9efb3e5866. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:26:55.379077 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Getting quotas for user c9dba948e7884033a7fc463bc287b484 and project 60ce37b8317a4c2dbd096f9efb3e5866. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:26:55.389874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:26:55.392205 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:26:55.440017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b52667ad-87b3-48b6-ac63-08a75566e485 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868822 Jun 24 09:26:55.440848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1486/3266] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 09:26:55.452666 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6e7b8782-3560-41b6-ad53-1989aacb87d1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:55.453269 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6e7b8782-3560-41b6-ad53-1989aacb87d1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:55.514025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6e7b8782-3560-41b6-ad53-1989aacb87d1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:55.522472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6e7b8782-3560-41b6-ad53-1989aacb87d1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1213 microversion: 2.1 time: 0.073138 Jun 24 09:26:55.523035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1781/3267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:55 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:56.132155 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-7d460c38-b1cb-4ca5-8006-8920cfd5f23b req-c4c6b2b5-ffee-47d0-b7f5-d0e784284323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e110c88-8145-4331-a023-db93d115ea78", "name": "network-vif-deleted", "tag": "ab177315-e080-44e4-a9b0-2c51e445a027"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:26:56.147570 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-7d460c38-b1cb-4ca5-8006-8920cfd5f23b req-c4c6b2b5-ffee-47d0-b7f5-d0e784284323 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.148125 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-7d460c38-b1cb-4ca5-8006-8920cfd5f23b req-c4c6b2b5-ffee-47d0-b7f5-d0e784284323 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.160649 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-7d460c38-b1cb-4ca5-8006-8920cfd5f23b req-c4c6b2b5-ffee-47d0-b7f5-d0e784284323 service nova] Creating event network-vif-deleted:ab177315-e080-44e4-a9b0-2c51e445a027 for instance 0e110c88-8145-4331-a023-db93d115ea78 on hv-cinder-78729 Jun 24 09:26:56.167032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-7d460c38-b1cb-4ca5-8006-8920cfd5f23b req-c4c6b2b5-ffee-47d0-b7f5-d0e784284323 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115232 Jun 24 09:26:56.168143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1487/3268] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:26:56.279485 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:56.280753 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:56.288402 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.289457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.290657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.291469 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.327590 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.328049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.328511 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lazy-loading 'fault' on Instance uuid 0e110c88-8145-4331-a023-db93d115ea78 {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:26:56.369862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:56.377279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-bf7e81ae-7b84-48ba-98e6-bfd7a8e7528e tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 200 len: 1327 microversion: 2.1 time: 0.101899 Jun 24 09:26:56.377869 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1782/3269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:56 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:56.540838 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:56.542057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:56.548433 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.548874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.549628 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:56.550085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:56.611561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:56.618663 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bf9e9eca-20d7-49db-a843-624d9143805b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1265 microversion: 2.1 time: 0.082339 Jun 24 09:26:56.619921 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1488/3270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:56 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:57.394529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:57.395135 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:57.402789 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:57.403236 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:57.404134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:57.404597 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:57.418894 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 HTTP/1.1 Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:26:57.420468 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:26:57.421604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '0e110c88-8145-4331-a023-db93d115ea78'} Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:26:57.422670 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:26:57.423692 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:26:57.424548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:26:57.424548 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-d247b882-7c2f-493a-80c1-5d0387ab10df tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 404 len: 111 microversion: 2.1 time: 0.031362 Jun 24 09:26:57.425645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1783/3271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:57 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:26:57.430917 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-41a02d27-fc3a-4647-ab89-78d0c286d461 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '.version_select at 0x7fa68c10d040>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:57.450391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-41a02d27-fc3a-4647-ab89-78d0c286d461 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607042678" status: 202 len: 0 microversion: 2.1 time: 0.023001 Jun 24 09:26:57.451195 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1489/3272] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 24 09:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607042678 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:26:57.641090 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:57.642146 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:57.648489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:57.648936 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:57.649718 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:57.650155 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:57.893685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:57.901121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0e2249f8-3472-49d2-8a58-76efcff3bbb0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.264570 Jun 24 09:26:57.901708 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1784/3273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:57 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:58.177231 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-7a451459-1ebb-4f83-9037-45cdcebd3248 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: .version_select at 0x7fa6900568b0>, body: {"keypair": {"name": "tempest-keypair-2076667242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvE7kLWWFScgE6OYyOQcrAWZitTq7Ap6m9kRIe+EK6Nr7NoD4lEYLOoSyS31MTZZwmfYSagnNEqiD23MHjxyAO2qVh5iOi8hPaWd9OuWEVzoB0GohYH0w0RXUpP1fordg=="}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:26:58.185173 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-6233a9d0-9f9a-4480-ab9b-264e20b3ff3f req-cd6e9bf6-69bd-4a40-a024-780b2faf9755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4fd03d1-651a-45ae-8a5f-5ac18de74b89", "tag": "fe1bac02-4dec-4ca5-8548-12d00136fe08"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:26:58.195184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-7a451459-1ebb-4f83-9037-45cdcebd3248 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for project c4e783e533d143e987b51dfdafc690ee. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:26:58.199054 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6233a9d0-9f9a-4480-ab9b-264e20b3ff3f req-cd6e9bf6-69bd-4a40-a024-780b2faf9755 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:58.199865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-6233a9d0-9f9a-4480-ab9b-264e20b3ff3f req-cd6e9bf6-69bd-4a40-a024-780b2faf9755 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:58.200176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-7a451459-1ebb-4f83-9037-45cdcebd3248 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for user 3b07944a2c124f2da28acaf4df2e215d and project c4e783e533d143e987b51dfdafc690ee. Resources: {'key_pairs'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:26:58.212350 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-6233a9d0-9f9a-4480-ab9b-264e20b3ff3f req-cd6e9bf6-69bd-4a40-a024-780b2faf9755 service nova] Creating event network-changed:fe1bac02-4dec-4ca5-8548-12d00136fe08 for instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 on hv-cinder-78729 Jun 24 09:26:58.217407 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-6233a9d0-9f9a-4480-ab9b-264e20b3ff3f req-cd6e9bf6-69bd-4a40-a024-780b2faf9755 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037827 Jun 24 09:26:58.218204 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1785/3274] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:26:58.229790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-7a451459-1ebb-4f83-9037-45cdcebd3248 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057030 Jun 24 09:26:58.230393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1490/3275] 10.222.0.48 () {60 vars in 1158 bytes} [Fri Jun 24 09:26:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:26:58.920328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:26:58.921112 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:26:58.928390 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:58.928845 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:58.929632 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:26:58.930095 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:26:59.067787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:26:59.075954 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e6412ef3-92b3-4f04-98e0-d6ac61895888 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.160271 Jun 24 09:26:59.076541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1786/3276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:26:58 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:59.834306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1242455090", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de77ebef-2b18-49b6-9d11-8b50b3a75944"}], "security_groups": [{"name": "tempest-securitygroup--2048380476"}], "key_name": "tempest-keypair-2076667242", "user_data": "}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:26:59.933771 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.network.neutron [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] validate_networks() for [('de77ebef-2b18-49b6-9d11-8b50b3a75944', None, None, None, None, None)] {{(pid=124405) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:27:00.092631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:00.093242 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:00.099729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:00.100184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:00.100957 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:00.101398 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:00.314174 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:00.323110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ab1ccba-05dc-431c-a0a5-d996a891e58a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.233272 Jun 24 09:27:00.323684 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1787/3277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:00 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:00.371640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Flavor limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:27:00.372084 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Image limits 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:27:00.372653 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Flavor pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:27:00.373027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Image pref 0:0:0 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:27:00.373429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.virt.hardware [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124405) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:27:00.382158 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:00.382600 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:00.383386 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:00.383815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:00.400371 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for project c4e783e533d143e987b51dfdafc690ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:27:00.404313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.quota [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Getting quotas for user 3b07944a2c124f2da28acaf4df2e215d and project c4e783e533d143e987b51dfdafc690ee. Resources: {'cores', 'ram', 'instances'} {{(pid=124405) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:27:00.415176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Going to run 1 instances... {{(pid=124405) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:27:00.417905 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124405) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:27:00.462476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-349a7869-4e37-4cb0-9d24-edbe9775239d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.632457 Jun 24 09:27:00.463139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1491/3278] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:26:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:27:00.473089 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fa56c0d5-5995-4906-acdb-88c7488010e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:00.473785 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fa56c0d5-5995-4906-acdb-88c7488010e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:00.528397 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fa56c0d5-5995-4906-acdb-88c7488010e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:00.535131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fa56c0d5-5995-4906-acdb-88c7488010e7 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1238 microversion: 2.1 time: 0.065948 Jun 24 09:27:00.535694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1788/3279] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:00 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:01.340430 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:01.341229 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:01.348172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:01.348747 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:01.349702 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:01.350217 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:01.491590 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:01.499728 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-714dbeae-c46b-4f4d-b11e-7c99319b1dd5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.163691 Jun 24 09:27:01.500313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1492/3280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:01 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:01.553098 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:01.554074 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:01.562617 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:01.563163 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:01.564264 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:01.564781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:01.638026 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:01.646046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e40689fb-749e-4cb4-9498-312f004e8700 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1290 microversion: 2.1 time: 0.096824 Jun 24 09:27:01.646781 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1789/3281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:01 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:02.523097 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:02.523844 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:02.530915 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:02.531357 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:02.532145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:02.532577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:02.669227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:02.670971 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:02.683941 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:02.684722 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:02.687074 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:02.687747 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:02.688622 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:02.696577 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-41e016c2-a07c-4007-ba33-9c7f0b228e43 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.177380 Jun 24 09:27:02.697743 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1493/3282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:02 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:02.864864 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:02.878232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2872dd0a-05bb-4798-b9d9-3dfe323e4016 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.218116 Jun 24 09:27:02.879470 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1790/3283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:02 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:02.923148 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-2cf0dc40-53c8-4960-93f4-4545bef58edf req-bbc07c7e-dd88-486a-a952-681763d85885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4fd03d1-651a-45ae-8a5f-5ac18de74b89", "name": "network-vif-plugged", "status": "completed", "tag": "fe1bac02-4dec-4ca5-8548-12d00136fe08"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:02.932353 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-2cf0dc40-53c8-4960-93f4-4545bef58edf req-bbc07c7e-dd88-486a-a952-681763d85885 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:02.932950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-2cf0dc40-53c8-4960-93f4-4545bef58edf req-bbc07c7e-dd88-486a-a952-681763d85885 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:02.944930 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-2cf0dc40-53c8-4960-93f4-4545bef58edf req-bbc07c7e-dd88-486a-a952-681763d85885 service nova] Creating event network-vif-plugged:fe1bac02-4dec-4ca5-8548-12d00136fe08 for instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 on hv-cinder-78729 Jun 24 09:27:02.950774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-2cf0dc40-53c8-4960-93f4-4545bef58edf req-bbc07c7e-dd88-486a-a952-681763d85885 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104422 Jun 24 09:27:02.951358 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1494/3284] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:27:03.385081 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-a949c888-88f1-43ca-8f07-0fe08fd78dcb req-72876ba3-e87b-4ce3-87d5-02909cf88c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052889c6-40df-4180-bb6c-307a5722c7ca", "tag": "39d678f4-4b78-4ee6-9597-1e00bcceb17d"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:03.395025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-a949c888-88f1-43ca-8f07-0fe08fd78dcb req-72876ba3-e87b-4ce3-87d5-02909cf88c4d service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:03.395506 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-a949c888-88f1-43ca-8f07-0fe08fd78dcb req-72876ba3-e87b-4ce3-87d5-02909cf88c4d service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:03.406901 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-a949c888-88f1-43ca-8f07-0fe08fd78dcb req-72876ba3-e87b-4ce3-87d5-02909cf88c4d service nova] Creating event network-changed:39d678f4-4b78-4ee6-9597-1e00bcceb17d for instance 052889c6-40df-4180-bb6c-307a5722c7ca on hv-cinder-78729 Jun 24 09:27:03.411929 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-a949c888-88f1-43ca-8f07-0fe08fd78dcb req-72876ba3-e87b-4ce3-87d5-02909cf88c4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030513 Jun 24 09:27:03.412519 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1791/3285] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:03.716091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:03.716725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:03.723180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:03.723626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:03.724391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:03.724932 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:03.856024 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:03.863518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-bb63b5a9-76f1-46ff-b9f6-0d2bbe61257b tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1313 microversion: 2.1 time: 0.153197 Jun 24 09:27:03.864085 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1495/3286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:03 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:03.896969 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:03.897685 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:03.904437 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:03.904886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:03.905642 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:03.906100 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:04.029049 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:04.036338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-80441fe5-4542-4509-ac7d-34439ea7a2fa tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.144005 Jun 24 09:27:04.036898 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1792/3287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:03 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:04.880132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:04.880711 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:04.887079 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:04.887522 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:04.888270 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:04.888700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.017606 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:05.025542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b73698ce-84e2-4e5b-9fe0-f15fc6ef811e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1496 microversion: 2.1 time: 0.148812 Jun 24 09:27:05.026140 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1496/3288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:04 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:05.053211 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:05.053942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:05.060586 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.061195 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.062061 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.062602 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.211466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:05.221623 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-be152bfb-89cf-4499-80a9-bb1ae704cebf tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.172203 Jun 24 09:27:05.225721 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1793/3289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:05 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:05.486926 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:05.487423 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:05.493827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.494278 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.495071 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.495507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.519561 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Going to try to terminate instance {{(pid=124405) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:27:05.595660 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b8c0edbe-36ed-4caa-8b33-992ce874e2ff tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 204 len: 0 microversion: 2.1 time: 0.112372 Jun 24 09:27:05.596236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1497/3290] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:27:05 2022] DELETE /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:05.604277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:05.604973 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:05.611037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.612017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.612301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:05.612733 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:05.743513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:05.751435 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-e411305a-48bf-4483-b6a5-54130bf70e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1502 microversion: 2.1 time: 0.150997 Jun 24 09:27:05.751991 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1794/3291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:05 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:06.240131 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:06.240823 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:06.248139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:06.248594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:06.249363 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:06.249837 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:06.378929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:06.386502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0e0d7c6d-acdb-480a-ac01-8b394082d3e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.150578 Jun 24 09:27:06.387073 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1498/3292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:06 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:06.768263 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:06.768865 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:06.776014 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:06.776399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:06.777143 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:06.777571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:06.906783 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:06.914342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8b7b74fc-3e7f-4338-9985-95cc919e02b0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1502 microversion: 2.1 time: 0.149950 Jun 24 09:27:06.914892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1795/3293] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:06 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:07.403725 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:07.404336 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:07.410815 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:07.411263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:07.412021 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:07.412456 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:07.536721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:07.544976 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b70b82b6-3b15-4fda-b366-aad827ecaa02 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.145597 Jun 24 09:27:07.545540 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1499/3294] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:07 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:07.931298 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:07.931944 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:07.938535 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:07.938982 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:07.939741 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:07.940176 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:08.064709 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:08.072133 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-41f8927e-888c-4db1-85e1-1496c0665610 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1502 microversion: 2.1 time: 0.144716 Jun 24 09:27:08.073329 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1796/3295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:07 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1502 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:08.561887 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:08.562502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:08.568942 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:08.569428 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:08.570236 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:08.570671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:08.698791 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:08.706086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d6f6abcc-14a2-4221-a545-d06efedc16b6 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.148044 Jun 24 09:27:08.706652 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1500/3296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:08 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:09.090466 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:09.090997 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:09.097419 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:09.097913 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:09.098674 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:09.099109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:09.225015 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:09.232481 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9c887049-b376-4880-865a-ada7cd3434f7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 200 len: 1502 microversion: 2.1 time: 0.146512 Jun 24 09:27:09.236434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1797/3297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:09 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:09.637571 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-6fc54ddf-725e-4c54-a677-84e1a5f0ba80 req-8c8d6677-473e-4981-ac6b-827565077294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4fd03d1-651a-45ae-8a5f-5ac18de74b89", "name": "network-vif-deleted", "tag": "fe1bac02-4dec-4ca5-8548-12d00136fe08"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:09.646461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6fc54ddf-725e-4c54-a677-84e1a5f0ba80 req-8c8d6677-473e-4981-ac6b-827565077294 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:09.646847 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-6fc54ddf-725e-4c54-a677-84e1a5f0ba80 req-8c8d6677-473e-4981-ac6b-827565077294 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:09.659684 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-6fc54ddf-725e-4c54-a677-84e1a5f0ba80 req-8c8d6677-473e-4981-ac6b-827565077294 service nova] Creating event network-vif-deleted:fe1bac02-4dec-4ca5-8548-12d00136fe08 for instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 on hv-cinder-78729 Jun 24 09:27:09.664765 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-6fc54ddf-725e-4c54-a677-84e1a5f0ba80 req-8c8d6677-473e-4981-ac6b-827565077294 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031837 Jun 24 09:27:09.665524 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1501/3298] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:09.723250 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:09.723863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:09.729917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:09.730370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:09.731130 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:09.731566 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:09.736267 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=100 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.863420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:09.871412 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2b368d7f-81c4-4e17-ba14-1adfb3659814 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.152087 Jun 24 09:27:09.871970 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1798/3299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:09 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:10.250196 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:10.250920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: a4fd03d1-651a-45ae-8a5f-5ac18de74b89] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:10.257030 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.257472 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.258289 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.258719 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.274745 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] HTTP exception thrown: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Request method failure captured: Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 HTTP/1.1 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYNd3KWvvsF5YxQz-yHBxfK8SYacKut7jDbfhqzL5ka2vVj7vFni5Q6vYP5N1ShJswH_cHwEUXk9hByPuEwXr93cRLKfj6geeyPPi7mpstfCmg5KpwQIf42cLqldtfvmWhKrPtIEcg-3yDh7U0LM5EHU5zcW5L-tNALc3274VDJlQMg Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 60ce37b8317a4c2dbd096f9efb3e5866 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:27:10.277225 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 60ce37b8317a4c2dbd096f9efb3e5866 Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesActionsTest-1988167718-project Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: c9dba948e7884033a7fc463bc287b484 Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesActionsTest-1988167718-project Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. Jun 24 09:27:10.278364 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': 'a4fd03d1-651a-45ae-8a5f-5ac18de74b89'} Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:27:10.278970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. Jun 24 09:27:10.280598 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:10.281537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Returning 404 to user: Instance a4fd03d1-651a-45ae-8a5f-5ac18de74b89 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:27:10.281537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-0d11a2e7-b57a-44ba-b5ea-1465ba0eab3f tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89" status: 404 len: 111 microversion: 2.1 time: 0.033188 Jun 24 09:27:10.281537 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1502/3300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:10 2022] GET /compute/v2.1/servers/a4fd03d1-651a-45ae-8a5f-5ac18de74b89 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:27:10.325951 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-980536244", "imageRef": "886028d8-1757-40f0-8f58-5ee1cb3bc65a", "flavorRef": "452", "networks": [{"uuid": "5fb987be-1bdc-4e2d-a76d-54869c1b9f08"}]}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:10.377911 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.network.neutron [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] validate_networks() for [('5fb987be-1bdc-4e2d-a76d-54869c1b9f08', None, None, None, None, None)] {{(pid=124404) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 09:27:10.533829 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=4 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.761884 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Flavor limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 09:27:10.762308 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Image limits 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 09:27:10.762790 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Flavor pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 09:27:10.763197 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Image pref 0:0:0 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 09:27:10.763604 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.virt.hardware [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124404) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 09:27:10.772336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.772787 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.773581 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.774046 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.792080 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Getting quotas for project 60ce37b8317a4c2dbd096f9efb3e5866. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 09:27:10.795975 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.quota [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Getting quotas for user c9dba948e7884033a7fc463bc287b484 and project 60ce37b8317a4c2dbd096f9efb3e5866. Resources: {'cores', 'ram', 'instances'} {{(pid=124404) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 09:27:10.809139 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Going to run 1 instances... {{(pid=124404) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 09:27:10.811460 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='886028d8-1757-40f0-8f58-5ee1cb3bc65a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124404) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 09:27:10.853888 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-a8958d34-4c39-4ff4-a222-aedcf4e1d5a6 req-99126981-81c0-4eae-b5aa-52916fd28745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052889c6-40df-4180-bb6c-307a5722c7ca", "name": "network-vif-plugged", "status": "completed", "tag": "39d678f4-4b78-4ee6-9597-1e00bcceb17d"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:10.857769 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [b5f87265-d8c2-4a29-bbc4-1b4b030ee810] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 09:27:10.859082 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=4 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.859724 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=16 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.864352 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-a8958d34-4c39-4ff4-a222-aedcf4e1d5a6 req-99126981-81c0-4eae-b5aa-52916fd28745 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.864945 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-a8958d34-4c39-4ff4-a222-aedcf4e1d5a6 req-99126981-81c0-4eae-b5aa-52916fd28745 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.876666 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-a8958d34-4c39-4ff4-a222-aedcf4e1d5a6 req-99126981-81c0-4eae-b5aa-52916fd28745 service nova] Creating event network-vif-plugged:39d678f4-4b78-4ee6-9597-1e00bcceb17d for instance 052889c6-40df-4180-bb6c-307a5722c7ca on hv-cinder-78729 Jun 24 09:27:10.881440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-a8958d34-4c39-4ff4-a222-aedcf4e1d5a6 req-99126981-81c0-4eae-b5aa-52916fd28745 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Jun 24 09:27:10.882280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1503/3301] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:10.888848 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:10.889542 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:10.895697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.896313 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:10.897091 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:10.897513 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:11.031794 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:11.035305 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.040432 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c4a95292-3bf2-4459-91d4-e1f7a73c54cc tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.156121 Jun 24 09:27:11.049651 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1504/3302] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:10 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:11.865185 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [b5f87265-d8c2-4a29-bbc4-1b4b030ee810] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 33540. Jun 24 09:27:11.870125 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-86464645-cc74-4ead-80c5-f54599e92a65 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548130 Jun 24 09:27:11.871332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1799/3303] 10.222.0.48 () {60 vars in 1146 bytes} [Fri Jun 24 09:27:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 09:27:11.880790 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-a548eb83-4dce-4202-afac-eb247d0147d8 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:11.881473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-a548eb83-4dce-4202-afac-eb247d0147d8 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:11.937160 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-a548eb83-4dce-4202-afac-eb247d0147d8 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:11.943796 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-a548eb83-4dce-4202-afac-eb247d0147d8 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1213 microversion: 2.1 time: 0.066783 Jun 24 09:27:11.944607 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1505/3304] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:11 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:12.057826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:12.058738 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:12.065508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:12.066025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:12.066976 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:12.068361 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:12.208172 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:12.216529 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-ea71ba94-a621-43c4-9a94-29d908e5bcba tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1364 microversion: 2.1 time: 0.163315 Jun 24 09:27:12.217082 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1800/3305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:12 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:12.960664 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:12.961193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:12.964609 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.969175 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:12.969626 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:12.970422 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:12.970861 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:13.033104 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:13.040795 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9a9cf1ec-71a3-490d-a3af-8a59a6b52a79 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1265 microversion: 2.1 time: 0.084090 Jun 24 09:27:13.041356 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1506/3306] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:12 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:13.234119 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:13.234763 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:13.241711 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:13.242522 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:13.243645 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:13.244224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:13.380138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:13.388355 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-9de0f5ca-ed62-46a2-8c07-0a3f2a8e29d5 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1549 microversion: 2.1 time: 0.158773 Jun 24 09:27:13.389037 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1801/3307] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:13 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:13.407203 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:13.407707 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:13.414176 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:13.414632 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:13.415421 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:13.415852 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:13.496755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c12305d6-b17c-4772-81d5-cd023dc51d49 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093903 Jun 24 09:27:13.497466 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1507/3308] 10.222.0.48 () {58 vars in 1274 bytes} [Fri Jun 24 09:27:13 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:14.057886 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:14.058494 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:14.064562 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:14.064999 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:14.065813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:14.066559 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:14.257592 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:14.266219 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-109a8711-2e2f-414b-a747-ec46a29abfc5 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.212347 Jun 24 09:27:14.266931 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1802/3309] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:14 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:14.680693 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-4aa4e661-e135-433f-9cd5-219ef8780500 req-f9f7dc07-29a8-4622-ba9a-df086d77e983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "109366f7-ae90-4c17-8c29-5ece6f0c533b", "tag": "70a18447-f948-464b-9832-a3c24b9f3786"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:14.696086 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-4aa4e661-e135-433f-9cd5-219ef8780500 req-f9f7dc07-29a8-4622-ba9a-df086d77e983 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:14.696772 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-4aa4e661-e135-433f-9cd5-219ef8780500 req-f9f7dc07-29a8-4622-ba9a-df086d77e983 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:14.712638 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-4aa4e661-e135-433f-9cd5-219ef8780500 req-f9f7dc07-29a8-4622-ba9a-df086d77e983 service nova] Creating event network-changed:70a18447-f948-464b-9832-a3c24b9f3786 for instance 109366f7-ae90-4c17-8c29-5ece6f0c533b on hv-cinder-78729 Jun 24 09:27:14.721971 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-4aa4e661-e135-433f-9cd5-219ef8780500 req-f9f7dc07-29a8-4622-ba9a-df086d77e983 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042545 Jun 24 09:27:14.723755 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1508/3310] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:14.820527 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-8dce2624-e1a5-4473-a585-a08bf3b5ce50 req-790cfbf3-81c4-466f-ae4f-344252cc87d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "052889c6-40df-4180-bb6c-307a5722c7ca", "tag": "39d678f4-4b78-4ee6-9597-1e00bcceb17d"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:14.829246 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-8dce2624-e1a5-4473-a585-a08bf3b5ce50 req-790cfbf3-81c4-466f-ae4f-344252cc87d5 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:14.829720 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-8dce2624-e1a5-4473-a585-a08bf3b5ce50 req-790cfbf3-81c4-466f-ae4f-344252cc87d5 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:14.842105 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-8dce2624-e1a5-4473-a585-a08bf3b5ce50 req-790cfbf3-81c4-466f-ae4f-344252cc87d5 service nova] Creating event network-changed:39d678f4-4b78-4ee6-9597-1e00bcceb17d for instance 052889c6-40df-4180-bb6c-307a5722c7ca on hv-cinder-78729 Jun 24 09:27:14.848003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-8dce2624-e1a5-4473-a585-a08bf3b5ce50 req-790cfbf3-81c4-466f-ae4f-344252cc87d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094391 Jun 24 09:27:14.848777 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1803/3311] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:15.284444 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:15.285163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:15.292529 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:15.292987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:15.293799 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:15.294243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:15.438635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:15.449446 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-eb865727-ebcf-413f-a2c5-938f091f3a5e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.169128 Jun 24 09:27:15.458703 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1509/3312] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:15 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:16.467170 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:16.467852 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:16.474138 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:16.474585 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:16.475333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:16.475761 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:16.604473 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:16.611826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-6d8e644e-8fd7-4de0-b685-529d14334543 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.150067 Jun 24 09:27:16.612392 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1804/3313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:16 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:17.630301 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:17.630920 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:17.638060 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:17.638506 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:17.639266 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:17.639697 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:17.764280 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:17.771629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-97378195-90be-4a54-8839-ccb65cc8b5b2 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.146764 Jun 24 09:27:17.772193 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1510/3314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:17 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:18.788332 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:18.789807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:18.797044 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:18.797489 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:18.798280 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:18.798710 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:18.938094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:18.946873 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-44e17551-99d4-4d88-bda1-53e9a745531e tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.162398 Jun 24 09:27:18.947444 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1805/3315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:18 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:19.964700 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:19.965300 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:19.971393 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:19.971859 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:19.972610 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:19.973048 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:20.099938 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:20.107990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-3c911eff-c107-42a9-85e0-3f8187d39277 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.147617 Jun 24 09:27:20.108557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1511/3316] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:19 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:20.847821 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-b4a7346a-05c1-4c8f-b0e4-e736bc9adafb req-53fbb5c3-e9ba-4c33-b027-c75bfdfb76da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109366f7-ae90-4c17-8c29-5ece6f0c533b", "name": "network-vif-plugged", "status": "completed", "tag": "70a18447-f948-464b-9832-a3c24b9f3786"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:20.851883 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.852680 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell0:SELECT=6 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.859025 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-b4a7346a-05c1-4c8f-b0e4-e736bc9adafb req-53fbb5c3-e9ba-4c33-b027-c75bfdfb76da service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:20.859478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-b4a7346a-05c1-4c8f-b0e4-e736bc9adafb req-53fbb5c3-e9ba-4c33-b027-c75bfdfb76da service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:20.871310 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-b4a7346a-05c1-4c8f-b0e4-e736bc9adafb req-53fbb5c3-e9ba-4c33-b027-c75bfdfb76da service nova] Creating event network-vif-plugged:70a18447-f948-464b-9832-a3c24b9f3786 for instance 109366f7-ae90-4c17-8c29-5ece6f0c533b on hv-cinder-78729 Jun 24 09:27:20.876190 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-b4a7346a-05c1-4c8f-b0e4-e736bc9adafb req-53fbb5c3-e9ba-4c33-b027-c75bfdfb76da service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Jun 24 09:27:20.876962 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1806/3317] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:21.124929 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:21.125538 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:21.132005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:21.132473 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:21.133224 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:21.133655 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:21.262268 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:21.269548 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6382fe0d-7dd0-4fad-8948-7597545092a4 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.148426 Jun 24 09:27:21.270138 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1512/3318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:21 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:22.287342 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:22.288033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:22.294508 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:22.294955 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:22.295702 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:22.296131 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:22.422050 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:22.429328 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-8ebc21f8-03b1-483c-aa44-5f39b6f56335 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1313 microversion: 2.1 time: 0.146725 Jun 24 09:27:22.429915 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1807/3319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:22 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:23.446566 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:23.447179 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:23.449113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell0:SELECT=2 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.454843 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:23.455291 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:23.456045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:23.456476 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:23.582286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:23.589931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d28e0c26-27ea-413a-a05e-e4f8575b7cd0 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1496 microversion: 2.1 time: 0.147212 Jun 24 09:27:23.590496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1513/3320] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:23 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1496 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:23.807558 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:27:23.807996 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:27:24.088091 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:24.089224 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:24.091593 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:24.096756 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:24.097203 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:24.097988 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:24.098420 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:24.124858 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:27:24.202262 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-0ccac2de-ce1b-4a8d-bb41-d703e0e50174 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "DELETE /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 204 len: 0 microversion: 2.1 time: 0.117699 Jun 24 09:27:24.202875 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1808/3321] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:27:24 2022] DELETE /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:24.211267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:24.211963 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:24.218310 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:24.218759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:24.219518 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:24.219952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:24.347991 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:24.355440 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1ce1c62e-44bd-4af4-bde1-ace0665b0e7a tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1502 microversion: 2.1 time: 0.148028 Jun 24 09:27:24.356005 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1514/3322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:24 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:25.373516 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:25.374315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:25.380661 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:25.381121 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:25.382003 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:25.382450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:25.509200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:25.516620 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-201167f1-616c-4d71-b3ad-deac697e1ca7 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1502 microversion: 2.1 time: 0.147337 Jun 24 09:27:25.517184 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1809/3323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:25 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:26.349877 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [req-d43a52f8-0710-4295-afd9-b6f49b78fcf9 req-5db1c83c-6cda-4435-8680-347c7784af6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "109366f7-ae90-4c17-8c29-5ece6f0c533b", "name": "network-vif-deleted", "tag": "70a18447-f948-464b-9832-a3c24b9f3786"}]} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:27:26.358782 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d43a52f8-0710-4295-afd9-b6f49b78fcf9 req-5db1c83c-6cda-4435-8680-347c7784af6b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:26.359214 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [req-d43a52f8-0710-4295-afd9-b6f49b78fcf9 req-5db1c83c-6cda-4435-8680-347c7784af6b service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:26.370953 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.compute.server_external_events [req-d43a52f8-0710-4295-afd9-b6f49b78fcf9 req-5db1c83c-6cda-4435-8680-347c7784af6b service nova] Creating event network-vif-deleted:70a18447-f948-464b-9832-a3c24b9f3786 for instance 109366f7-ae90-4c17-8c29-5ece6f0c533b on hv-cinder-78729 Jun 24 09:27:26.376475 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [req-d43a52f8-0710-4295-afd9-b6f49b78fcf9 req-5db1c83c-6cda-4435-8680-347c7784af6b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Jun 24 09:27:26.376955 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1515/3324] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:27:26.534107 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:26.534712 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:26.541336 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:26.542300 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:26.543055 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:26.543487 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:26.574232 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:26.574682 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:26.575154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.objects.instance [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lazy-loading 'fault' on Instance uuid 109366f7-ae90-4c17-8c29-5ece6f0c533b {{(pid=124404) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:27:26.614476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9dba948e7884033a7fc463bc287b484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ce37b8317a4c2dbd096f9efb3e5866', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:27:26.622515 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-70c412f5-5971-4fb1-9eae-b315a249c9f1 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 200 len: 1303 microversion: 2.1 time: 0.092341 Jun 24 09:27:26.623070 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1810/3325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:26 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:27.640944 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:27:27.641640 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] [instance: 109366f7-ae90-4c17-8c29-5ece6f0c533b] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:27:27.647812 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:27.648260 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:27.649016 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:27:27.649453 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:27:27.662417 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] HTTP exception thrown: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Request method failure captured: Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b HTTP/1.1 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYNd3KWvvsF5YxQz-yHBxfK8SYacKut7jDbfhqzL5ka2vVj7vFni5Q6vYP5N1ShJswH_cHwEUXk9hByPuEwXr93cRLKfj6geeyPPi7mpstfCmg5KpwQIf42cLqldtfvmWhKrPtIEcg-3yDh7U0LM5EHU5zcW5L-tNALc3274VDJlQMg Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: 60ce37b8317a4c2dbd096f9efb3e5866 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:27:27.664263 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/60ce37b8317a4c2dbd096f9efb3e5866"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: 60ce37b8317a4c2dbd096f9efb3e5866 Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-VolumesActionsTest-1988167718 Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-VolumesActionsTest-1988167718-project Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: c9dba948e7884033a7fc463bc287b484 Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-VolumesActionsTest-1988167718-project Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. Jun 24 09:27:27.665629 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '109366f7-ae90-4c17-8c29-5ece6f0c533b'} Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:27:27.666575 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. Jun 24 09:27:27.667896 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:27:27.668987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] Returning 404 to user: Instance 109366f7-ae90-4c17-8c29-5ece6f0c533b could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:27:27.668987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9fa9f78d-8a29-41e4-a425-6a1c8ae75468 tempest-VolumesActionsTest-1988167718 tempest-VolumesActionsTest-1988167718-project] 10.222.0.48 "GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b" status: 404 len: 111 microversion: 2.1 time: 0.029914 Jun 24 09:27:27.668987 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1516/3326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:27:27 2022] GET /compute/v2.1/servers/109366f7-ae90-4c17-8c29-5ece6f0c533b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:28:30.981784 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.982455 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.986717 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:30.987251 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:30.994950 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:30.995441 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:30.996196 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:30.996631 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:31.020804 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-2cfbe6ab-bd25-49d7-a6ae-c34b595e2e05 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/ips" status: 200 len: 143 microversion: 2.1 time: 0.040941 Jun 24 09:28:31.021370 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1811/3327] 10.222.0.48 () {58 vars in 1247 bytes} [Fri Jun 24 09:28:30 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/ips => generated 143 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:32.329248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_api:SELECT=20 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:32.330009 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG dbcounter [-] [124405] Writing DB stats nova_cell1:SELECT=52 {{(pid=124405) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:32.334174 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1192b65-0407-468c-b4c9-38340c66b820"}} {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:28:32.335267 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:32.342521 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:32.342970 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:32.343731 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:32.344172 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:32.596113 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-e75016e6-f8f8-4288-afd0-81157d585d60 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268417 Jun 24 09:28:32.596712 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1517/3328] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 09:28:32 2022] POST /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:40.080063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:40.081030 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:40.087571 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:40.088023 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:40.088813 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:40.089247 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:40.117729 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-3054cfc5-b680-4f5b-8012-debe596307fe tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041571 Jun 24 09:28:40.118279 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1812/3329] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:28:40 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:40.129824 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:40.130408 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:40.136603 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:40.137057 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:40.137880 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:40.138306 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:40.166322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-69a51af0-c6f2-4666-aeb3-fd9e9bfe5b3c tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820" status: 200 len: 194 microversion: 2.1 time: 0.041295 Jun 24 09:28:40.167479 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1518/3330] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 24 09:28:40 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 09:28:41.474942 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99f61467-a0c3-4175-8c29-22701edb37c7"}} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:28:41.476000 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:41.482472 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:41.482917 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:41.483673 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:41.484114 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:41.754835 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1f4f28b6-573e-41e3-bf1a-03946c484f95 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "POST /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283708 Jun 24 09:28:41.755434 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1813/3331] 10.222.0.48 () {60 vars in 1322 bytes} [Fri Jun 24 09:28:41 2022] POST /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:49.251774 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:49.252759 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:49.259183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.259625 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.261032 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.261461 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.289776 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-70342243-4007-4029-ae15-899a66ad7342 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041895 Jun 24 09:28:49.290322 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1519/3332] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:28:49 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:49.432109 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:49.432786 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:49.438903 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.439356 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.440110 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.440541 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.468458 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a5e7a0d0-2074-4dbf-886c-7d12f9b970e9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820" status: 200 len: 194 microversion: 2.1 time: 0.041869 Jun 24 09:28:49.469020 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1814/3333] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 24 09:28:49 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:49.478764 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:49.479286 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:49.485184 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.485635 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.486429 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:49.486874 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:49.566243 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lazy-loading 'services' on Instance uuid 052889c6-40df-4180-bb6c-307a5722c7ca {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:28:49.636129 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6401b0e1-5e7a-49e0-8ee6-894e5e6a9a2f tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820" status: 202 len: 0 microversion: 2.1 time: 0.161194 Jun 24 09:28:49.636721 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1520/3334] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:28:49 2022] DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/b1192b65-0407-468c-b4c9-38340c66b820 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:28:50.751607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:50.752134 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:50.760879 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:50.761340 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:50.762151 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:50.762578 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:50.796063 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-aab1465e-21b0-43aa-8f9d-af532d380e81 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/99f61467-a0c3-4175-8c29-22701edb37c7" status: 200 len: 194 microversion: 2.1 time: 0.048558 Jun 24 09:28:50.796636 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1815/3335] 10.222.0.48 () {58 vars in 1412 bytes} [Fri Jun 24 09:28:50 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/99f61467-a0c3-4175-8c29-22701edb37c7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:50.807931 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:50.808515 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:50.814671 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:50.815124 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:50.815890 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:50.816326 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:50.895623 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lazy-loading 'services' on Instance uuid 052889c6-40df-4180-bb6c-307a5722c7ca {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:28:50.964017 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-d9c82a46-45a1-4852-9004-e8bebaf3917a tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/99f61467-a0c3-4175-8c29-22701edb37c7" status: 202 len: 0 microversion: 2.1 time: 0.161171 Jun 24 09:28:50.964597 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1521/3336] 10.222.0.48 () {58 vars in 1415 bytes} [Fri Jun 24 09:28:50 2022] DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments/99f61467-a0c3-4175-8c29-22701edb37c7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:28:52.124017 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:52.124877 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:52.131418 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.131862 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.132607 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.133035 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.161900 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-7096c6f5-899a-4697-af34-9dd961e005a9 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041868 Jun 24 09:28:52.162443 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1816/3337] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:28:52 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:28:52.264950 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:52.265986 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:52.272035 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.272840 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.273605 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.274076 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.301557 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-c810615c-c2c6-476b-8635-9587cc7676d3 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041878 Jun 24 09:28:52.302132 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1522/3338] 10.222.0.48 () {58 vars in 1301 bytes} [Fri Jun 24 09:28:52 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 09:28:52.357834 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:52.358333 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:52.364200 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.364644 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.365393 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.365863 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.391757 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Going to try to terminate instance {{(pid=124404) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 09:28:52.463919 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-a047ca24-c325-4ecf-9225-523ef10f204b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 204 len: 0 microversion: 2.1 time: 0.109585 Jun 24 09:28:52.464547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1817/3339] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:28:52 2022] DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:52.473292 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:52.474012 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:52.480539 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.480977 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.481752 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:52.482183 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:52.610509 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:28:52.617901 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-1aaed916-7a14-4445-a805-7ca9ae9db87d tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1672 microversion: 2.1 time: 0.148707 Jun 24 09:28:52.618455 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1523/3340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:28:52 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:53.635992 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:53.636694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:53.643182 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:53.643652 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:53.644399 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:53.644826 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:53.772369 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.policy [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124404) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:28:53.779807 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-fa279570-736c-4b1d-9b85-556433df7c66 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1672 microversion: 2.1 time: 0.148074 Jun 24 09:28:53.780372 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1818/3341] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:28:53 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:54.797594 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:54.798228 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:54.804882 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:54.805340 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:54.806149 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:54.806593 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:54.938019 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:28:54.945391 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-b2956204-2498-432a-9f64-68ffbb9b0652 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1672 microversion: 2.1 time: 0.151698 Jun 24 09:28:54.945990 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1524/3342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:28:54 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:55.668217 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [req-249e17a0-421d-4d80-8cda-f1735b62d207 req-c7c3ba09-e0d6-473b-b41c-184c9d945439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "052889c6-40df-4180-bb6c-307a5722c7ca", "name": "network-vif-deleted", "tag": "39d678f4-4b78-4ee6-9597-1e00bcceb17d"}]} {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:28:55.677478 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-249e17a0-421d-4d80-8cda-f1735b62d207 req-c7c3ba09-e0d6-473b-b41c-184c9d945439 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:55.678076 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [req-249e17a0-421d-4d80-8cda-f1735b62d207 req-c7c3ba09-e0d6-473b-b41c-184c9d945439 service nova] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:55.700227 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.compute.server_external_events [req-249e17a0-421d-4d80-8cda-f1735b62d207 req-c7c3ba09-e0d6-473b-b41c-184c9d945439 service nova] Creating event network-vif-deleted:39d678f4-4b78-4ee6-9597-1e00bcceb17d for instance 052889c6-40df-4180-bb6c-307a5722c7ca on hv-cinder-78729 Jun 24 09:28:55.707762 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [req-249e17a0-421d-4d80-8cda-f1735b62d207 req-c7c3ba09-e0d6-473b-b41c-184c9d945439 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044343 Jun 24 09:28:55.708367 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1819/3343] 10.222.0.48 () {64 vars in 1317 bytes} [Fri Jun 24 09:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:28:55.963248 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:55.964144 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:55.970637 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:55.971178 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:55.972008 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:55.972445 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:56.002935 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:56.003377 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:56.003827 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.objects.instance [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lazy-loading 'fault' on Instance uuid 052889c6-40df-4180-bb6c-307a5722c7ca {{(pid=124405) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 09:28:56.044027 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.policy [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b07944a2c124f2da28acaf4df2e215d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4e783e533d143e987b51dfdafc690ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124405) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 09:28:56.052180 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-6cec461c-23c0-4e34-9613-7bc99ca0f64b tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 200 len: 1328 microversion: 2.1 time: 0.092837 Jun 24 09:28:56.052952 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1525/3344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:28:55 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 1328 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:57.070422 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:57.071120 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:57.078277 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:57.078724 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:57.079476 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:57.079910 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:57.093694 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca HTTP/1.1 Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:28:57.095457 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:57.096654 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '052889c6-40df-4180-bb6c-307a5722c7ca'} Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:28:57.097288 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:57.098338 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:57.099208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:28:57.099208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-c08c0f2b-291b-49d0-902a-614d9f05b591 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 404 len: 111 microversion: 2.1 time: 0.031305 Jun 24 09:28:57.099208 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1820/3345] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:28:57 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:28:57.108350 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-808090c6-fc69-43b0-8111-c7d7c9860c96 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '.version_select at 0x7fa68c0e4820>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:57.127170 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-808090c6-fc69-43b0-8111-c7d7c9860c96 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076667242" status: 202 len: 0 microversion: 2.1 time: 0.023821 Jun 24 09:28:57.127740 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1526/3346] 10.222.0.48 () {58 vars in 1220 bytes} [Fri Jun 24 09:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2076667242 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 09:28:59.971450 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:28:59.971946 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:28:59.978391 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:59.978830 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:59.979575 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:28:59.980641 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:28:59.993823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca HTTP/1.1 Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:28:59.995344 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:59.996695 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '052889c6-40df-4180-bb6c-307a5722c7ca'} Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:28:59.997513 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:28:59.998816 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.000198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:29:00.000198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-4b867e6b-1d02-4bb3-8637-4450cb589c76 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 404 len: 111 microversion: 2.1 time: 0.029052 Jun 24 09:29:00.000198 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1821/3347] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:28:59 2022] DELETE /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:29:00.005504 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:29:00.006143 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 052889c6-40df-4180-bb6c-307a5722c7ca] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:29:00.013119 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:00.013564 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:00.014347 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:00.014777 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:00.028145 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca HTTP/1.1 Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:29:00.029810 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:29:00.031078 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '052889c6-40df-4180-bb6c-307a5722c7ca'} Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:29:00.031879 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. Jun 24 09:29:00.033202 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:00.034507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 052889c6-40df-4180-bb6c-307a5722c7ca could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:29:00.034507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-9ac5990e-7758-41d8-b913-6fc264065553 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca" status: 404 len: 111 microversion: 2.1 time: 0.030098 Jun 24 09:29:00.034507 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1527/3348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:29:00 2022] GET /compute/v2.1/servers/052889c6-40df-4180-bb6c-307a5722c7ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:29:01.162730 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:29:01.163465 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.compute.api [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124404) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:29:01.165926 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.171094 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:01.171547 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:01.172301 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:01.172732 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG oslo_concurrency.lockutils [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124404) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:01.176058 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG dbcounter [-] [124404] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124404) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.189154 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.wsgi [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: request: DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 HTTP/1.1 Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept: application/json Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Accept-Encoding: identity Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Connection: close Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Length: 0 Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Content-Type: application/json Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Host: 10.222.0.48 Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Openstack-System-Scope: None Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: User-Agent: python-urllib3/1.26.9 Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Id: None Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Domain-Name: None Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Identity-Status: Confirmed Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Is-Admin-Project: True Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Id: default Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Domain-Name: Default Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Role: reader,member Jun 24 09:29:01.190802 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Roles: reader,member Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Id: default Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Domain-Name: Default Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: method: > Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: exception: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.192033 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: action_args: {'id': '0e110c88-8145-4331-a023-db93d115ea78'} Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: {{(pid=124404) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:29:01.192657 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.193608 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.194892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: DEBUG nova.api.openstack.wsgi [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. {{(pid=124404) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:29:01.194892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO nova.api.openstack.requestlog [None req-1656c4ae-d7b9-4307-8460-3f5a7d491d45 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 404 len: 111 microversion: 2.1 time: 0.033290 Jun 24 09:29:01.194892 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: [pid: 124404|app: 0|req: 1822/3349] 10.222.0.48 () {58 vars in 1238 bytes} [Fri Jun 24 09:29:01 2022] DELETE /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:29:01.201044 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Calling method '>' {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:29:01.201654 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.compute.api [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] [instance: 0e110c88-8145-4331-a023-db93d115ea78] Fetching instance by UUID {{(pid=124405) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 09:29:01.208045 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:01.208496 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:01.209249 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:29:01.209710 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG oslo_concurrency.lockutils [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Lock "2c923a23-3d41-45e5-8eb6-16c539602677" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124405) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:29:01.222555 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.wsgi [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] HTTP exception thrown: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Request method failure captured: Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: request: GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 HTTP/1.1 Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept: application/json Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Accept-Encoding: identity Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Connection: close Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Length: 0 Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Content-Type: application/json Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Host: 10.222.0.48 Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Openstack-System-Scope: None Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: User-Agent: python-urllib3/1.26.9 Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Auth-Token: gAAAAABitYIUx-ITt_vk13J4dlRNhDDzshD7sKb__gNypztpm8_RoUOudyDHz_6cqU-IxFDKEXbY3AGyVxAtS8CRcV3fSxmzg71IYMlhlwqOdzmUgT_aORlZhoUSPpz9KwO9nJA92wRz6pGaNVg9aiEGWP8OsFt8sHiUGPy0-MS5dc5O_qoXN2M Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Id: None Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Domain-Name: None Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Identity-Status: Confirmed Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Is-Admin-Project: True Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Id: default Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Domain-Name: Default Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Project-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Role: reader,member Jun 24 09:29:01.224042 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Roles: reader,member Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c4e783e533d143e987b51dfdafc690ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Id: c4e783e533d143e987b51dfdafc690ee Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-Tenant-Name: tempest-AttachVolumeTestJSON-728975501 Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Id: default Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Domain-Name: Default Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Id: 3b07944a2c124f2da28acaf4df2e215d Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: X-User-Name: tempest-AttachVolumeTestJSON-728975501-project Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: method: > Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: exception: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.225335 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: action_args: {'id': '0e110c88-8145-4331-a023-db93d115ea78'} Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: {{(pid=124405) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:29:01.226139 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. Jun 24 09:29:01.227133 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: ERROR nova.api.openstack.wsgi Jun 24 09:29:01.228037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: DEBUG nova.api.openstack.wsgi [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] Returning 404 to user: Instance 0e110c88-8145-4331-a023-db93d115ea78 could not be found. {{(pid=124405) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:29:01.228037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO nova.api.openstack.requestlog [None req-f7b6e46f-df17-4cf4-b8c0-aac37aecce59 tempest-AttachVolumeTestJSON-728975501 tempest-AttachVolumeTestJSON-728975501-project] 10.222.0.48 "GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78" status: 404 len: 111 microversion: 2.1 time: 0.028868 Jun 24 09:29:01.228037 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: [pid: 124405|app: 0|req: 1528/3350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri Jun 24 09:29:01 2022] GET /compute/v2.1/servers/0e110c88-8145-4331-a023-db93d115ea78 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 09:29:08.182147 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:29:08.183502 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:29:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:30:43.817079 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:30:43.817619 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:31:14.617007 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:31:14.617527 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:32:11.876315 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:32:11.876823 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:32:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:32:28.194553 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:32:28.195163 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:32:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:34:03.135569 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:34:03.136235 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:34:03.825395 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:34:03.825948 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:34:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:34:11.228394 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:34:11.229011 dv-cinder-787296-12-iscsi devstack@n-api.service[124404]: Fri Jun 24 09:34:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 09:34:34.627189 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 09:34:34.627672 dv-cinder-787296-12-iscsi devstack@n-api.service[124405]: Fri Jun 24 09:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!